2023-07-11 17:53:13,040 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.mob.compactions.TestMobCompactor timeout: 13 mins 2023-07-11 17:53:13,272 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/0ffa2fd0-9ac7-3acf-2d07-d63463e28c78 2023-07-11 17:53:13,285 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=1, rsPorts=, rsClass=null, numDataNodes=1, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-11 17:53:13,285 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/0ffa2fd0-9ac7-3acf-2d07-d63463e28c78/cluster_34dba087-9207-891f-190b-e8a2fc02141e, deleteOnExit=true 2023-07-11 17:53:13,285 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-11 17:53:13,286 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/0ffa2fd0-9ac7-3acf-2d07-d63463e28c78/test.cache.data in system properties and HBase conf 2023-07-11 17:53:13,286 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/0ffa2fd0-9ac7-3acf-2d07-d63463e28c78/hadoop.tmp.dir in system properties and HBase conf 2023-07-11 17:53:13,287 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/0ffa2fd0-9ac7-3acf-2d07-d63463e28c78/hadoop.log.dir in system properties and HBase conf 2023-07-11 17:53:13,287 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/0ffa2fd0-9ac7-3acf-2d07-d63463e28c78/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-11 17:53:13,287 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/0ffa2fd0-9ac7-3acf-2d07-d63463e28c78/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-11 17:53:13,288 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-11 17:53:13,403 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-07-11 17:53:13,837 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-11 17:53:13,840 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/0ffa2fd0-9ac7-3acf-2d07-d63463e28c78/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-11 17:53:13,841 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/0ffa2fd0-9ac7-3acf-2d07-d63463e28c78/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-11 17:53:13,841 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/0ffa2fd0-9ac7-3acf-2d07-d63463e28c78/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-11 17:53:13,841 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/0ffa2fd0-9ac7-3acf-2d07-d63463e28c78/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-11 17:53:13,842 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/0ffa2fd0-9ac7-3acf-2d07-d63463e28c78/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-11 17:53:13,842 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/0ffa2fd0-9ac7-3acf-2d07-d63463e28c78/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-11 17:53:13,842 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/0ffa2fd0-9ac7-3acf-2d07-d63463e28c78/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-11 17:53:13,843 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/0ffa2fd0-9ac7-3acf-2d07-d63463e28c78/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-11 17:53:13,843 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/0ffa2fd0-9ac7-3acf-2d07-d63463e28c78/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-11 17:53:13,844 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/0ffa2fd0-9ac7-3acf-2d07-d63463e28c78/nfs.dump.dir in system properties and HBase conf 2023-07-11 17:53:13,844 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/0ffa2fd0-9ac7-3acf-2d07-d63463e28c78/java.io.tmpdir in system properties and HBase conf 2023-07-11 17:53:13,844 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/0ffa2fd0-9ac7-3acf-2d07-d63463e28c78/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-11 17:53:13,845 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/0ffa2fd0-9ac7-3acf-2d07-d63463e28c78/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-11 17:53:13,845 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/0ffa2fd0-9ac7-3acf-2d07-d63463e28c78/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-11 17:53:14,437 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-11 17:53:14,441 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-11 17:53:14,736 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-07-11 17:53:14,911 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-07-11 17:53:14,929 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-11 17:53:14,982 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-07-11 17:53:15,029 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/0ffa2fd0-9ac7-3acf-2d07-d63463e28c78/java.io.tmpdir/Jetty_localhost_42643_hdfs____.j2hd9b/webapp 2023-07-11 17:53:15,183 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42643 2023-07-11 17:53:15,199 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-11 17:53:15,200 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-11 17:53:15,786 WARN [Listener at localhost/42127] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-11 17:53:15,878 WARN [Listener at localhost/42127] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-11 17:53:15,900 WARN [Listener at localhost/42127] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-11 17:53:15,905 INFO [Listener at localhost/42127] log.Slf4jLog(67): jetty-6.1.26 2023-07-11 17:53:15,910 INFO [Listener at localhost/42127] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/0ffa2fd0-9ac7-3acf-2d07-d63463e28c78/java.io.tmpdir/Jetty_localhost_46175_datanode____.ocge4s/webapp 2023-07-11 17:53:16,011 INFO [Listener at localhost/42127] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46175 2023-07-11 17:53:16,405 WARN [Listener at localhost/43271] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-11 17:53:16,909 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xaef37f4e1ef87405: Processing first storage report for DS-e5155cff-1e34-45a9-915a-6e3b0a098ed8 from datanode c68fe1db-4d65-4eb5-9533-0a1564728d74 2023-07-11 17:53:16,910 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xaef37f4e1ef87405: from storage DS-e5155cff-1e34-45a9-915a-6e3b0a098ed8 node DatanodeRegistration(127.0.0.1:46605, datanodeUuid=c68fe1db-4d65-4eb5-9533-0a1564728d74, infoPort=40289, infoSecurePort=0, ipcPort=43271, storageInfo=lv=-57;cid=testClusterID;nsid=2085011186;c=1689097994513), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-07-11 17:53:16,911 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xaef37f4e1ef87405: Processing first storage report for DS-abb597f2-560f-4eea-9101-57c4f9afe4e3 from datanode c68fe1db-4d65-4eb5-9533-0a1564728d74 2023-07-11 17:53:16,911 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xaef37f4e1ef87405: from storage DS-abb597f2-560f-4eea-9101-57c4f9afe4e3 node DatanodeRegistration(127.0.0.1:46605, datanodeUuid=c68fe1db-4d65-4eb5-9533-0a1564728d74, infoPort=40289, infoSecurePort=0, ipcPort=43271, storageInfo=lv=-57;cid=testClusterID;nsid=2085011186;c=1689097994513), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-11 17:53:16,922 DEBUG [Listener at localhost/43271] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/0ffa2fd0-9ac7-3acf-2d07-d63463e28c78 2023-07-11 17:53:16,985 INFO [Listener at localhost/43271] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/0ffa2fd0-9ac7-3acf-2d07-d63463e28c78/cluster_34dba087-9207-891f-190b-e8a2fc02141e/zookeeper_0, clientPort=50702, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/0ffa2fd0-9ac7-3acf-2d07-d63463e28c78/cluster_34dba087-9207-891f-190b-e8a2fc02141e/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/0ffa2fd0-9ac7-3acf-2d07-d63463e28c78/cluster_34dba087-9207-891f-190b-e8a2fc02141e/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-11 17:53:17,000 INFO [Listener at localhost/43271] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=50702 2023-07-11 17:53:17,007 INFO [Listener at localhost/43271] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 17:53:17,009 INFO [Listener at localhost/43271] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 17:53:17,676 INFO [Listener at localhost/43271] util.FSUtils(471): Created version file at hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88 with version=8 2023-07-11 17:53:17,676 INFO [Listener at localhost/43271] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/hbase-staging 2023-07-11 17:53:18,014 INFO [Listener at localhost/43271] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-07-11 17:53:18,519 INFO [Listener at localhost/43271] client.ConnectionUtils(127): master/jenkins-hbase9:0 server-side Connection retries=3 2023-07-11 17:53:18,564 INFO [Listener at localhost/43271] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-11 17:53:18,564 INFO [Listener at localhost/43271] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-11 17:53:18,565 INFO [Listener at localhost/43271] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-11 17:53:18,565 INFO [Listener at localhost/43271] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-11 17:53:18,565 INFO [Listener at localhost/43271] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-11 17:53:18,707 INFO [Listener at localhost/43271] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-11 17:53:18,805 DEBUG [Listener at localhost/43271] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-11 17:53:18,901 INFO [Listener at localhost/43271] ipc.NettyRpcServer(120): Bind to /172.31.2.10:36885 2023-07-11 17:53:18,911 INFO [Listener at localhost/43271] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 17:53:18,913 INFO [Listener at localhost/43271] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 17:53:18,934 INFO [Listener at localhost/43271] zookeeper.RecoverableZooKeeper(93): Process identifier=master:36885 connecting to ZooKeeper ensemble=127.0.0.1:50702 2023-07-11 17:53:18,975 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:368850x0, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-11 17:53:18,978 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:36885-0x1015576ce490000 connected 2023-07-11 17:53:19,014 DEBUG [Listener at localhost/43271] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-11 17:53:19,014 DEBUG [Listener at localhost/43271] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-11 17:53:19,018 DEBUG [Listener at localhost/43271] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-11 17:53:19,026 DEBUG [Listener at localhost/43271] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=36885 2023-07-11 17:53:19,026 DEBUG [Listener at localhost/43271] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=36885 2023-07-11 17:53:19,026 DEBUG [Listener at localhost/43271] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=36885 2023-07-11 17:53:19,027 DEBUG [Listener at localhost/43271] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=36885 2023-07-11 17:53:19,027 DEBUG [Listener at localhost/43271] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=36885 2023-07-11 17:53:19,033 INFO [Listener at localhost/43271] master.HMaster(444): hbase.rootdir=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88, hbase.cluster.distributed=false 2023-07-11 17:53:19,113 INFO [Listener at localhost/43271] client.ConnectionUtils(127): regionserver/jenkins-hbase9:0 server-side Connection retries=3 2023-07-11 17:53:19,114 INFO [Listener at localhost/43271] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-11 17:53:19,114 INFO [Listener at localhost/43271] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-11 17:53:19,114 INFO [Listener at localhost/43271] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-11 17:53:19,114 INFO [Listener at localhost/43271] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-11 17:53:19,115 INFO [Listener at localhost/43271] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-11 17:53:19,122 INFO [Listener at localhost/43271] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-11 17:53:19,125 INFO [Listener at localhost/43271] ipc.NettyRpcServer(120): Bind to /172.31.2.10:45839 2023-07-11 17:53:19,128 INFO [Listener at localhost/43271] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-11 17:53:19,136 DEBUG [Listener at localhost/43271] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-11 17:53:19,138 INFO [Listener at localhost/43271] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 17:53:19,140 INFO [Listener at localhost/43271] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 17:53:19,142 INFO [Listener at localhost/43271] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:45839 connecting to ZooKeeper ensemble=127.0.0.1:50702 2023-07-11 17:53:19,145 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:458390x0, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-11 17:53:19,146 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:45839-0x1015576ce490001 connected 2023-07-11 17:53:19,147 DEBUG [Listener at localhost/43271] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-11 17:53:19,148 DEBUG [Listener at localhost/43271] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-11 17:53:19,149 DEBUG [Listener at localhost/43271] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-11 17:53:19,150 DEBUG [Listener at localhost/43271] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=45839 2023-07-11 17:53:19,150 DEBUG [Listener at localhost/43271] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=45839 2023-07-11 17:53:19,150 DEBUG [Listener at localhost/43271] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=45839 2023-07-11 17:53:19,151 DEBUG [Listener at localhost/43271] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=45839 2023-07-11 17:53:19,151 DEBUG [Listener at localhost/43271] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=45839 2023-07-11 17:53:19,153 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase9.apache.org,36885,1689097997830 2023-07-11 17:53:19,162 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-11 17:53:19,163 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase9.apache.org,36885,1689097997830 2023-07-11 17:53:19,183 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-11 17:53:19,183 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-11 17:53:19,183 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 17:53:19,184 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-11 17:53:19,186 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase9.apache.org,36885,1689097997830 from backup master directory 2023-07-11 17:53:19,186 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-11 17:53:19,189 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase9.apache.org,36885,1689097997830 2023-07-11 17:53:19,189 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-11 17:53:19,190 WARN [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-11 17:53:19,190 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase9.apache.org,36885,1689097997830 2023-07-11 17:53:19,193 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-07-11 17:53:19,196 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-07-11 17:53:19,286 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/hbase.id with ID: 2cc80460-a06c-4b09-9075-e3a15620dc3a 2023-07-11 17:53:19,329 INFO [master/jenkins-hbase9:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 17:53:19,346 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 17:53:19,393 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x08f07289 to 127.0.0.1:50702 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 17:53:19,427 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@30a9ed3f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 17:53:19,451 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-11 17:53:19,453 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-11 17:53:19,471 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-07-11 17:53:19,471 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-07-11 17:53:19,473 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-11 17:53:19,477 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-11 17:53:19,478 INFO [master/jenkins-hbase9:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-11 17:53:19,513 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/MasterData/data/master/store-tmp 2023-07-11 17:53:19,544 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 17:53:19,544 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-11 17:53:19,544 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-11 17:53:19,544 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-11 17:53:19,544 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-11 17:53:19,545 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-11 17:53:19,545 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-11 17:53:19,545 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-11 17:53:19,546 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/MasterData/WALs/jenkins-hbase9.apache.org,36885,1689097997830 2023-07-11 17:53:19,571 INFO [master/jenkins-hbase9:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C36885%2C1689097997830, suffix=, logDir=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/MasterData/WALs/jenkins-hbase9.apache.org,36885,1689097997830, archiveDir=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/MasterData/oldWALs, maxLogs=10 2023-07-11 17:53:19,626 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46605,DS-e5155cff-1e34-45a9-915a-6e3b0a098ed8,DISK] 2023-07-11 17:53:19,634 DEBUG [RS-EventLoopGroup-3-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 17:53:19,693 INFO [master/jenkins-hbase9:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/MasterData/WALs/jenkins-hbase9.apache.org,36885,1689097997830/jenkins-hbase9.apache.org%2C36885%2C1689097997830.1689097999581 2023-07-11 17:53:19,694 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46605,DS-e5155cff-1e34-45a9-915a-6e3b0a098ed8,DISK]] 2023-07-11 17:53:19,694 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-11 17:53:19,695 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 17:53:19,698 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-11 17:53:19,699 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-11 17:53:19,755 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-11 17:53:19,762 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-11 17:53:19,785 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-11 17:53:19,797 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 17:53:19,802 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-11 17:53:19,804 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-11 17:53:19,818 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-11 17:53:19,822 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 17:53:19,824 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75218097, jitterRate=0.12083698809146881}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 17:53:19,824 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-11 17:53:19,825 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-11 17:53:19,843 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-11 17:53:19,844 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-11 17:53:19,846 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-11 17:53:19,848 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-11 17:53:19,880 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 31 msec 2023-07-11 17:53:19,880 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-11 17:53:19,904 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-11 17:53:19,910 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-11 17:53:19,939 INFO [master/jenkins-hbase9:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-11 17:53:19,943 INFO [master/jenkins-hbase9:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-11 17:53:19,945 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-11 17:53:19,950 INFO [master/jenkins-hbase9:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-11 17:53:19,954 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-11 17:53:19,958 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 17:53:19,959 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-11 17:53:19,959 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-11 17:53:19,970 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-11 17:53:19,975 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-11 17:53:19,975 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-11 17:53:19,976 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 17:53:19,976 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase9.apache.org,36885,1689097997830, sessionid=0x1015576ce490000, setting cluster-up flag (Was=false) 2023-07-11 17:53:19,990 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 17:53:19,996 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-11 17:53:19,997 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase9.apache.org,36885,1689097997830 2023-07-11 17:53:20,002 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 17:53:20,007 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-11 17:53:20,008 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase9.apache.org,36885,1689097997830 2023-07-11 17:53:20,011 WARN [master/jenkins-hbase9:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/.hbase-snapshot/.tmp 2023-07-11 17:53:20,055 INFO [RS:0;jenkins-hbase9:45839] regionserver.HRegionServer(951): ClusterId : 2cc80460-a06c-4b09-9075-e3a15620dc3a 2023-07-11 17:53:20,061 DEBUG [RS:0;jenkins-hbase9:45839] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-11 17:53:20,069 DEBUG [RS:0;jenkins-hbase9:45839] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-11 17:53:20,070 DEBUG [RS:0;jenkins-hbase9:45839] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-11 17:53:20,073 DEBUG [RS:0;jenkins-hbase9:45839] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-11 17:53:20,074 DEBUG [RS:0;jenkins-hbase9:45839] zookeeper.ReadOnlyZKClient(139): Connect 0x0fa7039a to 127.0.0.1:50702 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 17:53:20,079 DEBUG [RS:0;jenkins-hbase9:45839] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@160fc1e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 17:53:20,080 DEBUG [RS:0;jenkins-hbase9:45839] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@55f68ea, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-07-11 17:53:20,111 DEBUG [RS:0;jenkins-hbase9:45839] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase9:45839 2023-07-11 17:53:20,115 INFO [RS:0;jenkins-hbase9:45839] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-11 17:53:20,115 INFO [RS:0;jenkins-hbase9:45839] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-11 17:53:20,115 DEBUG [RS:0;jenkins-hbase9:45839] regionserver.HRegionServer(1022): About to register with Master. 2023-07-11 17:53:20,118 INFO [RS:0;jenkins-hbase9:45839] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase9.apache.org,36885,1689097997830 with isa=jenkins-hbase9.apache.org/172.31.2.10:45839, startcode=1689097999112 2023-07-11 17:53:20,135 DEBUG [RS:0;jenkins-hbase9:45839] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-11 17:53:20,146 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-11 17:53:20,157 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-07-11 17:53:20,157 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-07-11 17:53:20,158 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-07-11 17:53:20,158 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-07-11 17:53:20,158 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase9:0, corePoolSize=10, maxPoolSize=10 2023-07-11 17:53:20,158 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 17:53:20,158 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-07-11 17:53:20,158 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 17:53:20,159 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689098030159 2023-07-11 17:53:20,168 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-11 17:53:20,178 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-11 17:53:20,178 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-11 17:53:20,183 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-11 17:53:20,184 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-11 17:53:20,193 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-11 17:53:20,194 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-11 17:53:20,195 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-11 17:53:20,195 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-11 17:53:20,198 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-11 17:53:20,200 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-11 17:53:20,202 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-11 17:53:20,202 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-11 17:53:20,205 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-11 17:53:20,206 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:33913, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-11 17:53:20,206 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-11 17:53:20,209 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.large.0-1689098000208,5,FailOnTimeoutGroup] 2023-07-11 17:53:20,211 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.small.0-1689098000210,5,FailOnTimeoutGroup] 2023-07-11 17:53:20,211 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-11 17:53:20,211 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-11 17:53:20,213 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-11 17:53:20,214 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-11 17:53:20,222 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36885] master.ServerManager(394): Registering regionserver=jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:20,227 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-11 17:53:20,229 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-11 17:53:20,229 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88 2023-07-11 17:53:20,242 DEBUG [RS:0;jenkins-hbase9:45839] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88 2023-07-11 17:53:20,242 DEBUG [RS:0;jenkins-hbase9:45839] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:42127 2023-07-11 17:53:20,242 DEBUG [RS:0;jenkins-hbase9:45839] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-11 17:53:20,245 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 17:53:20,249 DEBUG [RS:0;jenkins-hbase9:45839] zookeeper.ZKUtil(162): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:20,248 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-11 17:53:20,249 WARN [RS:0;jenkins-hbase9:45839] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-11 17:53:20,250 INFO [RS:0;jenkins-hbase9:45839] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-11 17:53:20,250 DEBUG [RS:0;jenkins-hbase9:45839] regionserver.HRegionServer(1948): logDir=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/WALs/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:20,252 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-11 17:53:20,256 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/hbase/meta/1588230740/info 2023-07-11 17:53:20,256 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase9.apache.org,45839,1689097999112] 2023-07-11 17:53:20,257 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-11 17:53:20,262 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 17:53:20,262 DEBUG [RS:0;jenkins-hbase9:45839] zookeeper.ZKUtil(162): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:20,263 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-11 17:53:20,267 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/hbase/meta/1588230740/rep_barrier 2023-07-11 17:53:20,268 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-11 17:53:20,269 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 17:53:20,269 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-11 17:53:20,271 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/hbase/meta/1588230740/table 2023-07-11 17:53:20,272 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-11 17:53:20,273 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 17:53:20,275 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/hbase/meta/1588230740 2023-07-11 17:53:20,276 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/hbase/meta/1588230740 2023-07-11 17:53:20,277 DEBUG [RS:0;jenkins-hbase9:45839] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-11 17:53:20,280 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-11 17:53:20,282 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-11 17:53:20,286 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 17:53:20,287 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60705885, jitterRate=-0.09541182219982147}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-11 17:53:20,288 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-11 17:53:20,288 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-11 17:53:20,288 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-11 17:53:20,288 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-11 17:53:20,288 INFO [RS:0;jenkins-hbase9:45839] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-11 17:53:20,288 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-11 17:53:20,288 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-11 17:53:20,290 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-11 17:53:20,291 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-11 17:53:20,297 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-11 17:53:20,297 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-11 17:53:20,308 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-11 17:53:20,316 INFO [RS:0;jenkins-hbase9:45839] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-11 17:53:20,321 INFO [RS:0;jenkins-hbase9:45839] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-11 17:53:20,321 INFO [RS:0;jenkins-hbase9:45839] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-11 17:53:20,325 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-11 17:53:20,326 INFO [RS:0;jenkins-hbase9:45839] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-11 17:53:20,330 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-11 17:53:20,335 INFO [RS:0;jenkins-hbase9:45839] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=100, unit=MILLISECONDS is enabled. 2023-07-11 17:53:20,335 DEBUG [RS:0;jenkins-hbase9:45839] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 17:53:20,336 DEBUG [RS:0;jenkins-hbase9:45839] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 17:53:20,336 DEBUG [RS:0;jenkins-hbase9:45839] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 17:53:20,336 DEBUG [RS:0;jenkins-hbase9:45839] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 17:53:20,336 DEBUG [RS:0;jenkins-hbase9:45839] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 17:53:20,336 DEBUG [RS:0;jenkins-hbase9:45839] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-07-11 17:53:20,337 DEBUG [RS:0;jenkins-hbase9:45839] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 17:53:20,337 DEBUG [RS:0;jenkins-hbase9:45839] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 17:53:20,337 DEBUG [RS:0;jenkins-hbase9:45839] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 17:53:20,337 DEBUG [RS:0;jenkins-hbase9:45839] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 17:53:20,338 INFO [RS:0;jenkins-hbase9:45839] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-11 17:53:20,338 INFO [RS:0;jenkins-hbase9:45839] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-11 17:53:20,338 INFO [RS:0;jenkins-hbase9:45839] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-11 17:53:20,356 INFO [RS:0;jenkins-hbase9:45839] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-11 17:53:20,359 INFO [RS:0;jenkins-hbase9:45839] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,45839,1689097999112-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-11 17:53:20,381 INFO [RS:0;jenkins-hbase9:45839] regionserver.Replication(203): jenkins-hbase9.apache.org,45839,1689097999112 started 2023-07-11 17:53:20,381 INFO [RS:0;jenkins-hbase9:45839] regionserver.HRegionServer(1637): Serving as jenkins-hbase9.apache.org,45839,1689097999112, RpcServer on jenkins-hbase9.apache.org/172.31.2.10:45839, sessionid=0x1015576ce490001 2023-07-11 17:53:20,382 DEBUG [RS:0;jenkins-hbase9:45839] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-11 17:53:20,382 DEBUG [RS:0;jenkins-hbase9:45839] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:20,382 DEBUG [RS:0;jenkins-hbase9:45839] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,45839,1689097999112' 2023-07-11 17:53:20,382 DEBUG [RS:0;jenkins-hbase9:45839] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:53:20,383 DEBUG [RS:0;jenkins-hbase9:45839] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:53:20,383 DEBUG [RS:0;jenkins-hbase9:45839] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-11 17:53:20,383 DEBUG [RS:0;jenkins-hbase9:45839] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-11 17:53:20,383 DEBUG [RS:0;jenkins-hbase9:45839] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:20,383 DEBUG [RS:0;jenkins-hbase9:45839] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,45839,1689097999112' 2023-07-11 17:53:20,383 DEBUG [RS:0;jenkins-hbase9:45839] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 17:53:20,384 DEBUG [RS:0;jenkins-hbase9:45839] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 17:53:20,384 DEBUG [RS:0;jenkins-hbase9:45839] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-11 17:53:20,385 INFO [RS:0;jenkins-hbase9:45839] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-11 17:53:20,385 INFO [RS:0;jenkins-hbase9:45839] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-11 17:53:20,483 DEBUG [jenkins-hbase9:36885] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=1, allServersCount=1 2023-07-11 17:53:20,485 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase9.apache.org,45839,1689097999112, state=OPENING 2023-07-11 17:53:20,493 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-11 17:53:20,495 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 17:53:20,495 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-11 17:53:20,500 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase9.apache.org,45839,1689097999112}] 2023-07-11 17:53:20,500 INFO [RS:0;jenkins-hbase9:45839] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C45839%2C1689097999112, suffix=, logDir=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/WALs/jenkins-hbase9.apache.org,45839,1689097999112, archiveDir=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/oldWALs, maxLogs=32 2023-07-11 17:53:20,521 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46605,DS-e5155cff-1e34-45a9-915a-6e3b0a098ed8,DISK] 2023-07-11 17:53:20,527 INFO [RS:0;jenkins-hbase9:45839] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/WALs/jenkins-hbase9.apache.org,45839,1689097999112/jenkins-hbase9.apache.org%2C45839%2C1689097999112.1689098000503 2023-07-11 17:53:20,529 DEBUG [RS:0;jenkins-hbase9:45839] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46605,DS-e5155cff-1e34-45a9-915a-6e3b0a098ed8,DISK]] 2023-07-11 17:53:20,688 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:20,690 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-11 17:53:20,695 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:40098, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-11 17:53:20,711 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-11 17:53:20,711 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-11 17:53:20,720 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C45839%2C1689097999112.meta, suffix=.meta, logDir=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/WALs/jenkins-hbase9.apache.org,45839,1689097999112, archiveDir=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/oldWALs, maxLogs=32 2023-07-11 17:53:20,741 DEBUG [RS-EventLoopGroup-3-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46605,DS-e5155cff-1e34-45a9-915a-6e3b0a098ed8,DISK] 2023-07-11 17:53:20,746 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/WALs/jenkins-hbase9.apache.org,45839,1689097999112/jenkins-hbase9.apache.org%2C45839%2C1689097999112.meta.1689098000722.meta 2023-07-11 17:53:20,747 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46605,DS-e5155cff-1e34-45a9-915a-6e3b0a098ed8,DISK]] 2023-07-11 17:53:20,747 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-11 17:53:20,749 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-11 17:53:20,768 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-11 17:53:20,773 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-11 17:53:20,779 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-11 17:53:20,779 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 17:53:20,779 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-11 17:53:20,779 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-11 17:53:20,784 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-11 17:53:20,786 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/hbase/meta/1588230740/info 2023-07-11 17:53:20,786 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/hbase/meta/1588230740/info 2023-07-11 17:53:20,786 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-11 17:53:20,787 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 17:53:20,788 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-11 17:53:20,789 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/hbase/meta/1588230740/rep_barrier 2023-07-11 17:53:20,789 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/hbase/meta/1588230740/rep_barrier 2023-07-11 17:53:20,790 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-11 17:53:20,791 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 17:53:20,791 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-11 17:53:20,793 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/hbase/meta/1588230740/table 2023-07-11 17:53:20,793 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/hbase/meta/1588230740/table 2023-07-11 17:53:20,794 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-11 17:53:20,795 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 17:53:20,796 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/hbase/meta/1588230740 2023-07-11 17:53:20,799 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/hbase/meta/1588230740 2023-07-11 17:53:20,803 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-11 17:53:20,805 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-11 17:53:20,807 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68749844, jitterRate=0.024452507495880127}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-11 17:53:20,807 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-11 17:53:20,817 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1689098000680 2023-07-11 17:53:20,834 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-11 17:53:20,834 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-11 17:53:20,835 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase9.apache.org,45839,1689097999112, state=OPEN 2023-07-11 17:53:20,837 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-11 17:53:20,837 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-11 17:53:20,842 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-11 17:53:20,843 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase9.apache.org,45839,1689097999112 in 337 msec 2023-07-11 17:53:20,848 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-11 17:53:20,848 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 537 msec 2023-07-11 17:53:20,853 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 791 msec 2023-07-11 17:53:20,854 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1689098000854, completionTime=-1 2023-07-11 17:53:20,854 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=1; waited=0ms, expected min=1 server(s), max=1 server(s), master is running 2023-07-11 17:53:20,854 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-11 17:53:20,919 DEBUG [hconnection-0x1c25ffca-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 17:53:20,923 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:40108, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 17:53:20,945 INFO [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=1 2023-07-11 17:53:20,945 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689098060945 2023-07-11 17:53:20,945 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689098120945 2023-07-11 17:53:20,945 INFO [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 90 msec 2023-07-11 17:53:20,968 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,36885,1689097997830-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-11 17:53:20,969 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,36885,1689097997830-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-11 17:53:20,969 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,36885,1689097997830-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-11 17:53:20,970 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase9:36885, period=300000, unit=MILLISECONDS is enabled. 2023-07-11 17:53:20,971 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-11 17:53:20,976 DEBUG [master/jenkins-hbase9:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-11 17:53:20,984 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-11 17:53:20,986 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-11 17:53:20,995 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-11 17:53:20,997 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-11 17:53:20,999 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-11 17:53:21,020 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/.tmp/data/hbase/namespace/c81222d442c0705212f76de2b50cf141 2023-07-11 17:53:21,022 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/.tmp/data/hbase/namespace/c81222d442c0705212f76de2b50cf141 empty. 2023-07-11 17:53:21,023 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/.tmp/data/hbase/namespace/c81222d442c0705212f76de2b50cf141 2023-07-11 17:53:21,023 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-11 17:53:21,044 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-11 17:53:21,046 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => c81222d442c0705212f76de2b50cf141, NAME => 'hbase:namespace,,1689098000985.c81222d442c0705212f76de2b50cf141.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/.tmp 2023-07-11 17:53:21,458 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689098000985.c81222d442c0705212f76de2b50cf141.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 17:53:21,458 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing c81222d442c0705212f76de2b50cf141, disabling compactions & flushes 2023-07-11 17:53:21,458 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689098000985.c81222d442c0705212f76de2b50cf141. 2023-07-11 17:53:21,458 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689098000985.c81222d442c0705212f76de2b50cf141. 2023-07-11 17:53:21,458 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689098000985.c81222d442c0705212f76de2b50cf141. after waiting 0 ms 2023-07-11 17:53:21,458 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689098000985.c81222d442c0705212f76de2b50cf141. 2023-07-11 17:53:21,459 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689098000985.c81222d442c0705212f76de2b50cf141. 2023-07-11 17:53:21,459 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for c81222d442c0705212f76de2b50cf141: 2023-07-11 17:53:21,464 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-11 17:53:21,478 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1689098000985.c81222d442c0705212f76de2b50cf141.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689098001466"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689098001466"}]},"ts":"1689098001466"} 2023-07-11 17:53:21,505 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-11 17:53:21,507 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-11 17:53:21,511 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689098001507"}]},"ts":"1689098001507"} 2023-07-11 17:53:21,514 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-11 17:53:21,524 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=c81222d442c0705212f76de2b50cf141, ASSIGN}] 2023-07-11 17:53:21,526 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=c81222d442c0705212f76de2b50cf141, ASSIGN 2023-07-11 17:53:21,528 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=c81222d442c0705212f76de2b50cf141, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,45839,1689097999112; forceNewPlan=false, retain=false 2023-07-11 17:53:21,679 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=c81222d442c0705212f76de2b50cf141, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:21,680 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1689098000985.c81222d442c0705212f76de2b50cf141.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689098001679"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689098001679"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689098001679"}]},"ts":"1689098001679"} 2023-07-11 17:53:21,684 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure c81222d442c0705212f76de2b50cf141, server=jenkins-hbase9.apache.org,45839,1689097999112}] 2023-07-11 17:53:21,845 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1689098000985.c81222d442c0705212f76de2b50cf141. 2023-07-11 17:53:21,846 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c81222d442c0705212f76de2b50cf141, NAME => 'hbase:namespace,,1689098000985.c81222d442c0705212f76de2b50cf141.', STARTKEY => '', ENDKEY => ''} 2023-07-11 17:53:21,847 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace c81222d442c0705212f76de2b50cf141 2023-07-11 17:53:21,847 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689098000985.c81222d442c0705212f76de2b50cf141.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 17:53:21,848 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for c81222d442c0705212f76de2b50cf141 2023-07-11 17:53:21,848 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for c81222d442c0705212f76de2b50cf141 2023-07-11 17:53:21,850 INFO [StoreOpener-c81222d442c0705212f76de2b50cf141-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region c81222d442c0705212f76de2b50cf141 2023-07-11 17:53:21,853 DEBUG [StoreOpener-c81222d442c0705212f76de2b50cf141-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/hbase/namespace/c81222d442c0705212f76de2b50cf141/info 2023-07-11 17:53:21,853 DEBUG [StoreOpener-c81222d442c0705212f76de2b50cf141-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/hbase/namespace/c81222d442c0705212f76de2b50cf141/info 2023-07-11 17:53:21,853 INFO [StoreOpener-c81222d442c0705212f76de2b50cf141-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c81222d442c0705212f76de2b50cf141 columnFamilyName info 2023-07-11 17:53:21,854 INFO [StoreOpener-c81222d442c0705212f76de2b50cf141-1] regionserver.HStore(310): Store=c81222d442c0705212f76de2b50cf141/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 17:53:21,856 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/hbase/namespace/c81222d442c0705212f76de2b50cf141 2023-07-11 17:53:21,857 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/hbase/namespace/c81222d442c0705212f76de2b50cf141 2023-07-11 17:53:21,862 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for c81222d442c0705212f76de2b50cf141 2023-07-11 17:53:21,867 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/hbase/namespace/c81222d442c0705212f76de2b50cf141/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 17:53:21,868 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened c81222d442c0705212f76de2b50cf141; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63753152, jitterRate=-0.050004005432128906}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 17:53:21,868 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for c81222d442c0705212f76de2b50cf141: 2023-07-11 17:53:21,871 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1689098000985.c81222d442c0705212f76de2b50cf141., pid=6, masterSystemTime=1689098001838 2023-07-11 17:53:21,876 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1689098000985.c81222d442c0705212f76de2b50cf141. 2023-07-11 17:53:21,876 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1689098000985.c81222d442c0705212f76de2b50cf141. 2023-07-11 17:53:21,877 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=c81222d442c0705212f76de2b50cf141, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:21,878 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1689098000985.c81222d442c0705212f76de2b50cf141.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689098001876"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689098001876"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689098001876"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689098001876"}]},"ts":"1689098001876"} 2023-07-11 17:53:21,888 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-11 17:53:21,888 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure c81222d442c0705212f76de2b50cf141, server=jenkins-hbase9.apache.org,45839,1689097999112 in 200 msec 2023-07-11 17:53:21,891 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-11 17:53:21,892 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=c81222d442c0705212f76de2b50cf141, ASSIGN in 364 msec 2023-07-11 17:53:21,893 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-11 17:53:21,893 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689098001893"}]},"ts":"1689098001893"} 2023-07-11 17:53:21,896 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-11 17:53:21,900 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-11 17:53:21,901 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-11 17:53:21,903 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 914 msec 2023-07-11 17:53:21,903 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-11 17:53:21,903 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 17:53:21,944 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-11 17:53:21,961 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-11 17:53:21,966 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 33 msec 2023-07-11 17:53:21,977 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-11 17:53:21,988 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-11 17:53:21,992 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 14 msec 2023-07-11 17:53:22,005 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-11 17:53:22,007 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-11 17:53:22,007 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 2.817sec 2023-07-11 17:53:22,009 INFO [master/jenkins-hbase9:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-11 17:53:22,010 INFO [master/jenkins-hbase9:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-11 17:53:22,011 INFO [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-11 17:53:22,012 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,36885,1689097997830-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-11 17:53:22,012 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,36885,1689097997830-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-11 17:53:22,022 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-11 17:53:22,064 DEBUG [Listener at localhost/43271] zookeeper.ReadOnlyZKClient(139): Connect 0x1480d1ce to 127.0.0.1:50702 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 17:53:22,069 DEBUG [Listener at localhost/43271] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2364b594, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 17:53:22,080 DEBUG [hconnection-0x33f7ff8b-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 17:53:22,090 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:49874, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 17:53:22,100 INFO [Listener at localhost/43271] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase9.apache.org,36885,1689097997830 2023-07-11 17:53:22,101 DEBUG [Listener at localhost/43271] zookeeper.ReadOnlyZKClient(139): Connect 0x57816685 to 127.0.0.1:50702 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 17:53:22,105 DEBUG [Listener at localhost/43271] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7038d7b4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 17:53:22,105 INFO [Listener at localhost/43271] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 17:53:22,131 INFO [Listener at localhost/43271] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthly Thread=212, OpenFileDescriptor=478, MaxFileDescriptor=60000, SystemLoadAverage=237, ProcessCount=170, AvailableMemoryMB=9114 2023-07-11 17:53:22,141 DEBUG [Listener at localhost/43271] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-11 17:53:22,145 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:59056, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-11 17:53:22,159 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-07-11 17:53:22,161 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:22,162 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_PRE_OPERATION 2023-07-11 17:53:22,164 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-11 17:53:22,166 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthly" procId is: 9 2023-07-11 17:53:22,167 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e3f02074d49896da91a4a986ed5a3926 2023-07-11 17:53:22,168 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e3f02074d49896da91a4a986ed5a3926 empty. 2023-07-11 17:53:22,170 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e3f02074d49896da91a4a986ed5a3926 2023-07-11 17:53:22,170 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthly regions 2023-07-11 17:53:22,176 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-11 17:53:22,280 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-11 17:53:22,482 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-11 17:53:22,587 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000001 2023-07-11 17:53:22,590 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(7675): creating {ENCODED => e3f02074d49896da91a4a986ed5a3926, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1689098002155.e3f02074d49896da91a4a986ed5a3926.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/.tmp 2023-07-11 17:53:22,785 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-11 17:53:23,003 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1689098002155.e3f02074d49896da91a4a986ed5a3926.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 17:53:23,004 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1604): Closing e3f02074d49896da91a4a986ed5a3926, disabling compactions & flushes 2023-07-11 17:53:23,004 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1689098002155.e3f02074d49896da91a4a986ed5a3926. 2023-07-11 17:53:23,004 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1689098002155.e3f02074d49896da91a4a986ed5a3926. 2023-07-11 17:53:23,004 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1689098002155.e3f02074d49896da91a4a986ed5a3926. after waiting 0 ms 2023-07-11 17:53:23,004 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1689098002155.e3f02074d49896da91a4a986ed5a3926. 2023-07-11 17:53:23,004 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1689098002155.e3f02074d49896da91a4a986ed5a3926. 2023-07-11 17:53:23,004 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1558): Region close journal for e3f02074d49896da91a4a986ed5a3926: 2023-07-11 17:53:23,009 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_ADD_TO_META 2023-07-11 17:53:23,011 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1689098002155.e3f02074d49896da91a4a986ed5a3926.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1689098003010"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689098003010"}]},"ts":"1689098003010"} 2023-07-11 17:53:23,014 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-11 17:53:23,016 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-11 17:53:23,016 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689098003016"}]},"ts":"1689098003016"} 2023-07-11 17:53:23,019 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthly, state=ENABLING in hbase:meta 2023-07-11 17:53:23,023 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=e3f02074d49896da91a4a986ed5a3926, ASSIGN}] 2023-07-11 17:53:23,027 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=e3f02074d49896da91a4a986ed5a3926, ASSIGN 2023-07-11 17:53:23,029 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=e3f02074d49896da91a4a986ed5a3926, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,45839,1689097999112; forceNewPlan=false, retain=false 2023-07-11 17:53:23,181 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=e3f02074d49896da91a4a986ed5a3926, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:23,181 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1689098002155.e3f02074d49896da91a4a986ed5a3926.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1689098003181"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689098003181"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689098003181"}]},"ts":"1689098003181"} 2023-07-11 17:53:23,184 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure e3f02074d49896da91a4a986ed5a3926, server=jenkins-hbase9.apache.org,45839,1689097999112}] 2023-07-11 17:53:23,287 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-11 17:53:23,343 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthly,,1689098002155.e3f02074d49896da91a4a986ed5a3926. 2023-07-11 17:53:23,344 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e3f02074d49896da91a4a986ed5a3926, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1689098002155.e3f02074d49896da91a4a986ed5a3926.', STARTKEY => '', ENDKEY => ''} 2023-07-11 17:53:23,344 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthly e3f02074d49896da91a4a986ed5a3926 2023-07-11 17:53:23,344 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1689098002155.e3f02074d49896da91a4a986ed5a3926.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 17:53:23,344 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for e3f02074d49896da91a4a986ed5a3926 2023-07-11 17:53:23,344 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for e3f02074d49896da91a4a986ed5a3926 2023-07-11 17:53:23,347 INFO [StoreOpener-e3f02074d49896da91a4a986ed5a3926-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region e3f02074d49896da91a4a986ed5a3926 2023-07-11 17:53:23,349 DEBUG [StoreOpener-e3f02074d49896da91a4a986ed5a3926-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e3f02074d49896da91a4a986ed5a3926/family1 2023-07-11 17:53:23,350 DEBUG [StoreOpener-e3f02074d49896da91a4a986ed5a3926-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e3f02074d49896da91a4a986ed5a3926/family1 2023-07-11 17:53:23,352 INFO [StoreOpener-e3f02074d49896da91a4a986ed5a3926-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e3f02074d49896da91a4a986ed5a3926 columnFamilyName family1 2023-07-11 17:53:23,355 INFO [StoreOpener-e3f02074d49896da91a4a986ed5a3926-1] regionserver.HStore(310): Store=e3f02074d49896da91a4a986ed5a3926/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 17:53:23,358 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e3f02074d49896da91a4a986ed5a3926 2023-07-11 17:53:23,359 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e3f02074d49896da91a4a986ed5a3926 2023-07-11 17:53:23,362 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for e3f02074d49896da91a4a986ed5a3926 2023-07-11 17:53:23,366 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e3f02074d49896da91a4a986ed5a3926/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 17:53:23,367 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened e3f02074d49896da91a4a986ed5a3926; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65720283, jitterRate=-0.020691469311714172}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 17:53:23,367 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for e3f02074d49896da91a4a986ed5a3926: 2023-07-11 17:53:23,368 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthly,,1689098002155.e3f02074d49896da91a4a986ed5a3926., pid=11, masterSystemTime=1689098003337 2023-07-11 17:53:23,372 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthly,,1689098002155.e3f02074d49896da91a4a986ed5a3926. 2023-07-11 17:53:23,372 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthly,,1689098002155.e3f02074d49896da91a4a986ed5a3926. 2023-07-11 17:53:23,372 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=e3f02074d49896da91a4a986ed5a3926, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:23,372 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1689098002155.e3f02074d49896da91a4a986ed5a3926.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1689098003372"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689098003372"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689098003372"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689098003372"}]},"ts":"1689098003372"} 2023-07-11 17:53:23,380 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-07-11 17:53:23,380 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure e3f02074d49896da91a4a986ed5a3926, server=jenkins-hbase9.apache.org,45839,1689097999112 in 192 msec 2023-07-11 17:53:23,383 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-07-11 17:53:23,384 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=e3f02074d49896da91a4a986ed5a3926, ASSIGN in 357 msec 2023-07-11 17:53:23,386 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-11 17:53:23,386 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689098003386"}]},"ts":"1689098003386"} 2023-07-11 17:53:23,388 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthly, state=ENABLED in hbase:meta 2023-07-11 17:53:23,393 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_POST_OPERATION 2023-07-11 17:53:23,396 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 1.2340 sec 2023-07-11 17:53:24,289 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-11 17:53:24,290 INFO [Listener at localhost/43271] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthly, procId: 9 completed 2023-07-11 17:53:24,312 DEBUG [hconnection-0x1b47742f-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 17:53:24,315 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:49888, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 17:53:24,456 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 17:53:24,463 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:24,463 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-07-11 17:53:24,463 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:53:24,464 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-07-11 17:53:24,464 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-07-11 17:53:24,464 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:24,465 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:24,466 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:53:24,466 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:24,466 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:53:24,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:53:24,467 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:24,467 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 17:53:24,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:24,467 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:24,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 17:53:24,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:24,468 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:24,470 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:24,470 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-07-11 17:53:24,470 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:53:24,471 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-07-11 17:53:24,471 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 17:53:24,471 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 17:53:24,472 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1689098002155.e3f02074d49896da91a4a986ed5a3926. 2023-07-11 17:53:24,472 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1689098002155.e3f02074d49896da91a4a986ed5a3926. started... 2023-07-11 17:53:24,473 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e3f02074d49896da91a4a986ed5a3926 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-07-11 17:53:25,015 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511303a92630b46d3400293b1ec3a0b8ef84e to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511303a92630b46d3400293b1ec3a0b8ef84e 2023-07-11 17:53:25,431 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e3f02074d49896da91a4a986ed5a3926/.tmp/family1/c4a01f29d2dc4888ae763621af859873 2023-07-11 17:53:25,442 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e3f02074d49896da91a4a986ed5a3926/.tmp/family1/c4a01f29d2dc4888ae763621af859873 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e3f02074d49896da91a4a986ed5a3926/family1/c4a01f29d2dc4888ae763621af859873 2023-07-11 17:53:25,452 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e3f02074d49896da91a4a986ed5a3926/family1/c4a01f29d2dc4888ae763621af859873, entries=1000, sequenceid=5, filesize=175.8 K 2023-07-11 17:53:25,455 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for e3f02074d49896da91a4a986ed5a3926 in 982ms, sequenceid=5, compaction requested=false 2023-07-11 17:53:25,457 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-07-11 17:53:25,460 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e3f02074d49896da91a4a986ed5a3926: 2023-07-11 17:53:25,460 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1689098002155.e3f02074d49896da91a4a986ed5a3926. 2023-07-11 17:53:25,460 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 17:53:25,460 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 17:53:25,461 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:25,461 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-07-11 17:53:25,461 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-07-11 17:53:25,464 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:25,464 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:25,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:25,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:53:25,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:53:25,465 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:25,465 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 17:53:25,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:53:25,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:53:25,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:25,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:25,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:53:25,467 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-07-11 17:53:25,467 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-07-11 17:53:25,467 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@707d34f0[Count = 0] remaining members to acquire global barrier 2023-07-11 17:53:25,467 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:25,469 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:25,469 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:25,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:25,469 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-07-11 17:53:25,469 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-07-11 17:53:25,469 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:25,469 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase9.apache.org,45839,1689097999112' in zk 2023-07-11 17:53:25,469 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 17:53:25,473 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-07-11 17:53:25,473 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:25,473 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:53:25,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:25,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:53:25,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:53:25,473 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-07-11 17:53:25,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:53:25,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:53:25,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:25,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:25,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:53:25,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:25,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:25,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase9.apache.org,45839,1689097999112': 2023-07-11 17:53:25,477 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-07-11 17:53:25,477 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 17:53:25,477 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-07-11 17:53:25,477 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 17:53:25,477 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:25,477 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 17:53:25,480 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:25,480 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:25,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:25,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:53:25,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:53:25,480 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:25,480 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:53:25,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:25,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:53:25,481 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:53:25,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:53:25,481 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:25,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:25,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:25,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:53:25,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:25,482 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:25,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:25,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:53:25,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:25,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:25,489 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:25,489 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:53:25,489 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:25,490 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:53:25,490 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:53:25,490 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:25,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:53:25,490 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-07-11 17:53:25,490 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 17:53:25,490 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:25,490 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:53:25,490 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:25,491 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:25,491 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:25,491 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:53:25,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:53:25,492 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-07-11 17:53:25,492 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 17:53:25,592 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 17:53:25,597 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 17:53:25,607 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 17:53:25,610 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-07-11 17:53:25,610 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:25,610 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-07-11 17:53:25,610 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:53:25,611 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-07-11 17:53:25,611 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-07-11 17:53:25,611 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:25,612 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:25,613 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:53:25,613 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:25,613 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:53:25,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:53:25,614 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:25,614 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 17:53:25,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:25,614 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:25,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 17:53:25,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:25,615 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:25,615 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-07-11 17:53:25,615 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:25,615 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-07-11 17:53:25,615 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:53:25,616 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-07-11 17:53:25,616 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 17:53:25,616 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 17:53:25,616 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1689098002155.e3f02074d49896da91a4a986ed5a3926. 2023-07-11 17:53:25,616 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1689098002155.e3f02074d49896da91a4a986ed5a3926. started... 2023-07-11 17:53:25,616 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e3f02074d49896da91a4a986ed5a3926 1/1 column families, dataSize=74 B heapSize=408 B 2023-07-11 17:53:26,044 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128d4b03672aaf646cd96ff1adf2bb243bc to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151128d4b03672aaf646cd96ff1adf2bb243bc 2023-07-11 17:53:26,297 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-07-11 17:53:26,359 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-11 17:53:26,360 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-11 17:53:26,457 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e3f02074d49896da91a4a986ed5a3926/.tmp/family1/fd6e90d2a376479083e3672021f11038 2023-07-11 17:53:26,466 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e3f02074d49896da91a4a986ed5a3926/.tmp/family1/fd6e90d2a376479083e3672021f11038 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e3f02074d49896da91a4a986ed5a3926/family1/fd6e90d2a376479083e3672021f11038 2023-07-11 17:53:26,475 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e3f02074d49896da91a4a986ed5a3926/family1/fd6e90d2a376479083e3672021f11038, entries=1, sequenceid=9, filesize=5.0 K 2023-07-11 17:53:26,476 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for e3f02074d49896da91a4a986ed5a3926 in 860ms, sequenceid=9, compaction requested=false 2023-07-11 17:53:26,476 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e3f02074d49896da91a4a986ed5a3926: 2023-07-11 17:53:26,476 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1689098002155.e3f02074d49896da91a4a986ed5a3926. 2023-07-11 17:53:26,476 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 17:53:26,477 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 17:53:26,477 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:26,477 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-07-11 17:53:26,477 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-07-11 17:53:26,479 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:26,479 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:26,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:26,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:53:26,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:53:26,479 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:26,479 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 17:53:26,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:53:26,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:53:26,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:26,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:26,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:53:26,481 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-07-11 17:53:26,481 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5be625a1[Count = 0] remaining members to acquire global barrier 2023-07-11 17:53:26,481 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-07-11 17:53:26,481 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:26,482 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:26,482 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:26,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:26,482 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-07-11 17:53:26,482 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-07-11 17:53:26,482 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase9.apache.org,45839,1689097999112' in zk 2023-07-11 17:53:26,483 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:26,483 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 17:53:26,484 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-07-11 17:53:26,484 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:53:26,484 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:26,484 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-07-11 17:53:26,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:26,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:53:26,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:53:26,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:53:26,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:53:26,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:26,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:26,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:53:26,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:26,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:26,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase9.apache.org,45839,1689097999112': 2023-07-11 17:53:26,488 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-07-11 17:53:26,488 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-07-11 17:53:26,488 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 17:53:26,488 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 17:53:26,488 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:26,488 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 17:53:26,497 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:26,498 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:26,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:26,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:53:26,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:53:26,498 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:26,498 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:53:26,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:26,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:53:26,498 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:53:26,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:53:26,498 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:26,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:26,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:26,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:53:26,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:26,500 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:26,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:26,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:53:26,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:26,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:26,504 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:26,504 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:53:26,504 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:53:26,504 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:26,504 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:53:26,504 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-07-11 17:53:26,504 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:26,504 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-07-11 17:53:26,504 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 17:53:26,504 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:53:26,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:53:26,504 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:26,505 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:26,505 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:26,505 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:26,505 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-07-11 17:53:26,505 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:53:26,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:53:26,505 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 17:53:26,605 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 17:53:26,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 17:53:26,615 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 17:53:26,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-07-11 17:53:26,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:26,618 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-07-11 17:53:26,618 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:53:26,618 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-07-11 17:53:26,618 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-07-11 17:53:26,619 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:26,619 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:26,621 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:53:26,621 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:26,621 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:53:26,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:53:26,621 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:26,621 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 17:53:26,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:26,622 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:26,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 17:53:26,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:26,622 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:26,622 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-07-11 17:53:26,622 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:26,623 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-07-11 17:53:26,623 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:53:26,623 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-07-11 17:53:26,623 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 17:53:26,623 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 17:53:26,623 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1689098002155.e3f02074d49896da91a4a986ed5a3926. 2023-07-11 17:53:26,623 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1689098002155.e3f02074d49896da91a4a986ed5a3926. started... 2023-07-11 17:53:26,624 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e3f02074d49896da91a4a986ed5a3926 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-11 17:53:27,048 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512014f37b7050d1040a7b6f20d3835a0b152 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512014f37b7050d1040a7b6f20d3835a0b152 2023-07-11 17:53:27,461 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e3f02074d49896da91a4a986ed5a3926/.tmp/family1/365556570f004b2a8bd872ca45b2d3c4 2023-07-11 17:53:27,470 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e3f02074d49896da91a4a986ed5a3926/.tmp/family1/365556570f004b2a8bd872ca45b2d3c4 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e3f02074d49896da91a4a986ed5a3926/family1/365556570f004b2a8bd872ca45b2d3c4 2023-07-11 17:53:27,479 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e3f02074d49896da91a4a986ed5a3926/family1/365556570f004b2a8bd872ca45b2d3c4, entries=1, sequenceid=13, filesize=5.0 K 2023-07-11 17:53:27,480 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e3f02074d49896da91a4a986ed5a3926 in 856ms, sequenceid=13, compaction requested=true 2023-07-11 17:53:27,481 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e3f02074d49896da91a4a986ed5a3926: 2023-07-11 17:53:27,481 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1689098002155.e3f02074d49896da91a4a986ed5a3926. 2023-07-11 17:53:27,481 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 17:53:27,482 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 17:53:27,482 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:27,482 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-07-11 17:53:27,482 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-07-11 17:53:27,484 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:27,484 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:27,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:27,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:53:27,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:53:27,485 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:27,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:53:27,485 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 17:53:27,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:53:27,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:27,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:27,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:53:27,487 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-07-11 17:53:27,487 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@37990550[Count = 0] remaining members to acquire global barrier 2023-07-11 17:53:27,487 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-07-11 17:53:27,487 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:27,489 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:27,489 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:27,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:27,490 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-07-11 17:53:27,490 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-07-11 17:53:27,490 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase9.apache.org,45839,1689097999112' in zk 2023-07-11 17:53:27,490 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:27,490 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 17:53:27,492 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-07-11 17:53:27,492 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:27,492 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:53:27,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:27,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:53:27,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:53:27,492 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-07-11 17:53:27,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:53:27,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:53:27,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:27,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:27,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:53:27,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:27,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:27,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase9.apache.org,45839,1689097999112': 2023-07-11 17:53:27,495 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-07-11 17:53:27,495 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-07-11 17:53:27,495 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 17:53:27,495 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 17:53:27,495 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:27,496 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 17:53:27,498 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:27,498 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:27,498 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:27,498 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:53:27,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:27,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:27,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:53:27,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:53:27,498 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:53:27,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:53:27,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:53:27,499 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:27,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:27,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:27,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:53:27,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:27,500 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:27,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:27,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:53:27,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:27,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:27,504 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:53:27,504 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:27,504 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:53:27,504 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:27,504 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-07-11 17:53:27,504 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 17:53:27,504 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:53:27,504 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:27,504 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-07-11 17:53:27,504 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:53:27,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:53:27,505 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:27,505 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:27,505 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:27,505 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:27,505 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-07-11 17:53:27,505 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 17:53:27,505 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:53:27,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:53:27,606 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 17:53:27,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 17:53:27,615 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 17:53:27,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-07-11 17:53:27,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:27,617 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-07-11 17:53:27,617 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:53:27,618 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-07-11 17:53:27,618 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-07-11 17:53:27,619 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:27,619 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:27,621 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:53:27,621 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:27,621 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:53:27,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:53:27,622 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:27,622 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 17:53:27,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:27,622 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:27,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 17:53:27,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:27,623 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:27,623 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-07-11 17:53:27,623 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:27,623 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-07-11 17:53:27,623 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:53:27,623 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-07-11 17:53:27,624 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 17:53:27,624 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 17:53:27,624 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1689098002155.e3f02074d49896da91a4a986ed5a3926. 2023-07-11 17:53:27,624 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1689098002155.e3f02074d49896da91a4a986ed5a3926. started... 2023-07-11 17:53:27,624 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e3f02074d49896da91a4a986ed5a3926 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-11 17:53:28,007 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-11 17:53:28,008 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-11 17:53:28,049 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205441d50a3727e4a49b8238e54656766f0 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151205441d50a3727e4a49b8238e54656766f0 2023-07-11 17:53:28,461 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e3f02074d49896da91a4a986ed5a3926/.tmp/family1/e78550397a16412c95860df9f769ec11 2023-07-11 17:53:28,470 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e3f02074d49896da91a4a986ed5a3926/.tmp/family1/e78550397a16412c95860df9f769ec11 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e3f02074d49896da91a4a986ed5a3926/family1/e78550397a16412c95860df9f769ec11 2023-07-11 17:53:28,479 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e3f02074d49896da91a4a986ed5a3926/family1/e78550397a16412c95860df9f769ec11, entries=1, sequenceid=17, filesize=5.0 K 2023-07-11 17:53:28,481 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e3f02074d49896da91a4a986ed5a3926 in 857ms, sequenceid=17, compaction requested=true 2023-07-11 17:53:28,481 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e3f02074d49896da91a4a986ed5a3926: 2023-07-11 17:53:28,481 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1689098002155.e3f02074d49896da91a4a986ed5a3926. 2023-07-11 17:53:28,481 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 17:53:28,482 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 17:53:28,482 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:28,482 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-07-11 17:53:28,482 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-07-11 17:53:28,484 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:28,484 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:28,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:28,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:53:28,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:53:28,484 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:28,484 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 17:53:28,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:53:28,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:53:28,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:28,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:28,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:53:28,487 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-07-11 17:53:28,487 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@707bd28d[Count = 0] remaining members to acquire global barrier 2023-07-11 17:53:28,487 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-07-11 17:53:28,488 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:28,489 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:28,489 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:28,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:28,489 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-07-11 17:53:28,489 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-07-11 17:53:28,490 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase9.apache.org,45839,1689097999112' in zk 2023-07-11 17:53:28,490 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:28,490 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 17:53:28,492 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:28,492 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-07-11 17:53:28,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:28,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:53:28,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:53:28,492 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:53:28,492 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-07-11 17:53:28,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:53:28,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:53:28,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:28,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:28,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:53:28,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:28,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:28,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase9.apache.org,45839,1689097999112': 2023-07-11 17:53:28,496 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-07-11 17:53:28,496 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-07-11 17:53:28,496 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 17:53:28,496 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 17:53:28,496 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:28,496 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 17:53:28,500 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:28,500 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:28,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:28,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:53:28,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:53:28,500 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:28,500 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:53:28,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:28,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:53:28,501 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:53:28,501 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:28,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:53:28,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:28,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:28,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:53:28,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:28,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:28,541 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:28,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:53:28,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:28,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:28,557 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:28,557 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:53:28,557 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:53:28,557 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:28,558 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:28,558 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:53:28,557 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-07-11 17:53:28,558 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 17:53:28,557 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:53:28,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:53:28,558 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:28,558 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:28,558 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:28,558 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:28,559 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-07-11 17:53:28,559 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 17:53:28,559 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:53:28,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:53:28,659 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 17:53:28,661 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 17:53:28,668 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 17:53:28,670 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-07-11 17:53:28,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:28,671 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-07-11 17:53:28,671 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:53:28,671 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-07-11 17:53:28,671 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-07-11 17:53:28,672 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:28,672 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:28,673 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:28,673 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:53:28,673 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:53:28,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:53:28,674 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:28,674 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 17:53:28,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:28,674 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:28,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 17:53:28,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:28,675 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:28,675 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:28,675 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-07-11 17:53:28,675 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:53:28,676 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-07-11 17:53:28,676 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 17:53:28,676 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 17:53:28,676 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1689098002155.e3f02074d49896da91a4a986ed5a3926. 2023-07-11 17:53:28,676 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1689098002155.e3f02074d49896da91a4a986ed5a3926. started... 2023-07-11 17:53:28,676 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e3f02074d49896da91a4a986ed5a3926 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-11 17:53:29,098 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015122810ac4a08d3064fe681929311e9799bc6 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015122810ac4a08d3064fe681929311e9799bc6 2023-07-11 17:53:29,510 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e3f02074d49896da91a4a986ed5a3926/.tmp/family1/fb7ae29957844f42aef8cc56714bb039 2023-07-11 17:53:29,519 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e3f02074d49896da91a4a986ed5a3926/.tmp/family1/fb7ae29957844f42aef8cc56714bb039 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e3f02074d49896da91a4a986ed5a3926/family1/fb7ae29957844f42aef8cc56714bb039 2023-07-11 17:53:29,526 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e3f02074d49896da91a4a986ed5a3926/family1/fb7ae29957844f42aef8cc56714bb039, entries=1, sequenceid=21, filesize=5.0 K 2023-07-11 17:53:29,528 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e3f02074d49896da91a4a986ed5a3926 in 852ms, sequenceid=21, compaction requested=true 2023-07-11 17:53:29,528 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e3f02074d49896da91a4a986ed5a3926: 2023-07-11 17:53:29,528 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1689098002155.e3f02074d49896da91a4a986ed5a3926. 2023-07-11 17:53:29,528 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 17:53:29,529 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 17:53:29,529 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:29,529 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-07-11 17:53:29,529 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-07-11 17:53:29,535 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:29,535 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:29,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:29,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:53:29,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:53:29,535 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:29,535 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 17:53:29,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:53:29,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:53:29,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:29,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:29,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:53:29,537 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-07-11 17:53:29,537 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@69b8b2c6[Count = 0] remaining members to acquire global barrier 2023-07-11 17:53:29,537 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-07-11 17:53:29,537 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:29,538 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:29,538 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:29,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:29,538 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-07-11 17:53:29,538 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-07-11 17:53:29,538 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase9.apache.org,45839,1689097999112' in zk 2023-07-11 17:53:29,538 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:29,538 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 17:53:29,540 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-07-11 17:53:29,540 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:29,540 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:53:29,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:29,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:53:29,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:53:29,540 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-07-11 17:53:29,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:53:29,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:53:29,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:29,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:29,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:53:29,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:29,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:29,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase9.apache.org,45839,1689097999112': 2023-07-11 17:53:29,543 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-07-11 17:53:29,543 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-07-11 17:53:29,543 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 17:53:29,543 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 17:53:29,543 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:29,543 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 17:53:29,545 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:29,545 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:29,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:29,545 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:29,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:53:29,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:53:29,545 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:53:29,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:29,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:53:29,545 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:53:29,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:53:29,545 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:29,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:29,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:29,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:53:29,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:29,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:29,547 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:29,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:53:29,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:29,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:29,550 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:29,550 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:53:29,550 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:29,550 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:53:29,550 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:29,550 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-07-11 17:53:29,551 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 17:53:29,550 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-07-11 17:53:29,550 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:53:29,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:53:29,550 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:53:29,550 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:29,551 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:29,551 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:29,551 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:29,551 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-07-11 17:53:29,551 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:53:29,551 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 17:53:29,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:53:29,652 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 17:53:29,653 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 17:53:29,661 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 17:53:29,663 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-07-11 17:53:29,663 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:29,663 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-07-11 17:53:29,663 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:53:29,664 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-07-11 17:53:29,664 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-07-11 17:53:29,665 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:29,665 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:29,666 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:53:29,666 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:29,666 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:53:29,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:53:29,666 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:29,666 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 17:53:29,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:29,667 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:29,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 17:53:29,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:29,667 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:29,667 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-07-11 17:53:29,667 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:29,667 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-07-11 17:53:29,668 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:53:29,668 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-07-11 17:53:29,668 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 17:53:29,668 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 17:53:29,668 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1689098002155.e3f02074d49896da91a4a986ed5a3926. 2023-07-11 17:53:29,668 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1689098002155.e3f02074d49896da91a4a986ed5a3926. started... 2023-07-11 17:53:29,668 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e3f02074d49896da91a4a986ed5a3926 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-11 17:53:29,688 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231015842724497419d973d6924c74da6e1 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151231015842724497419d973d6924c74da6e1 2023-07-11 17:53:30,098 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e3f02074d49896da91a4a986ed5a3926/.tmp/family1/b4fcb054f5814e7e86e9c0f85232fbcd 2023-07-11 17:53:30,106 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e3f02074d49896da91a4a986ed5a3926/.tmp/family1/b4fcb054f5814e7e86e9c0f85232fbcd as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e3f02074d49896da91a4a986ed5a3926/family1/b4fcb054f5814e7e86e9c0f85232fbcd 2023-07-11 17:53:30,114 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e3f02074d49896da91a4a986ed5a3926/family1/b4fcb054f5814e7e86e9c0f85232fbcd, entries=1, sequenceid=25, filesize=5.0 K 2023-07-11 17:53:30,115 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e3f02074d49896da91a4a986ed5a3926 in 447ms, sequenceid=25, compaction requested=true 2023-07-11 17:53:30,115 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e3f02074d49896da91a4a986ed5a3926: 2023-07-11 17:53:30,115 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1689098002155.e3f02074d49896da91a4a986ed5a3926. 2023-07-11 17:53:30,116 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 17:53:30,116 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 17:53:30,116 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:30,116 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-07-11 17:53:30,116 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-07-11 17:53:30,118 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:30,118 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:30,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:30,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:53:30,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:53:30,118 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:30,118 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 17:53:30,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:53:30,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:53:30,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:30,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:30,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:53:30,121 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-07-11 17:53:30,121 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@319597d[Count = 0] remaining members to acquire global barrier 2023-07-11 17:53:30,121 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-07-11 17:53:30,121 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:30,122 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:30,122 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:30,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:30,123 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-07-11 17:53:30,123 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-07-11 17:53:30,123 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase9.apache.org,45839,1689097999112' in zk 2023-07-11 17:53:30,123 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:30,123 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 17:53:30,126 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-07-11 17:53:30,126 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:30,126 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:53:30,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:30,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:53:30,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:53:30,126 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-07-11 17:53:30,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:53:30,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:53:30,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:30,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:30,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:53:30,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:30,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:30,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase9.apache.org,45839,1689097999112': 2023-07-11 17:53:30,129 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-07-11 17:53:30,129 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-07-11 17:53:30,129 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 17:53:30,129 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 17:53:30,129 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:30,129 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 17:53:30,131 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:30,131 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:30,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:30,131 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:53:30,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:53:30,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:53:30,131 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:30,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:30,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:53:30,132 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:53:30,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:53:30,132 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:30,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:30,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:30,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:53:30,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:30,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:30,133 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:30,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:53:30,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:30,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:30,136 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:30,136 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:53:30,136 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:30,136 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:53:30,136 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:53:30,136 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:53:30,136 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-07-11 17:53:30,136 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 17:53:30,136 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:30,136 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-07-11 17:53:30,137 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:30,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:53:30,137 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:30,137 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:30,137 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:30,137 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-07-11 17:53:30,137 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:53:30,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:53:30,137 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 17:53:30,237 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 17:53:30,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 17:53:30,247 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 17:53:30,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-07-11 17:53:30,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:30,249 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-07-11 17:53:30,249 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:53:30,249 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-07-11 17:53:30,249 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-07-11 17:53:30,250 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:30,250 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:30,251 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:53:30,251 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:30,251 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:53:30,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:53:30,252 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:30,252 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 17:53:30,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:30,252 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:30,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 17:53:30,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:30,254 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:30,254 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-07-11 17:53:30,254 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:30,254 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-07-11 17:53:30,254 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:53:30,254 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-07-11 17:53:30,255 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 17:53:30,255 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 17:53:30,255 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1689098002155.e3f02074d49896da91a4a986ed5a3926. 2023-07-11 17:53:30,255 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1689098002155.e3f02074d49896da91a4a986ed5a3926. started... 2023-07-11 17:53:30,255 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e3f02074d49896da91a4a986ed5a3926 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-11 17:53:30,681 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101ea0505e1e8484c018f21494e1b7f45bb to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160101ea0505e1e8484c018f21494e1b7f45bb 2023-07-11 17:53:31,089 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e3f02074d49896da91a4a986ed5a3926/.tmp/family1/164b9d1862074342b9c128666d36f9d3 2023-07-11 17:53:31,097 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e3f02074d49896da91a4a986ed5a3926/.tmp/family1/164b9d1862074342b9c128666d36f9d3 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e3f02074d49896da91a4a986ed5a3926/family1/164b9d1862074342b9c128666d36f9d3 2023-07-11 17:53:31,106 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e3f02074d49896da91a4a986ed5a3926/family1/164b9d1862074342b9c128666d36f9d3, entries=1, sequenceid=29, filesize=5.0 K 2023-07-11 17:53:31,107 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e3f02074d49896da91a4a986ed5a3926 in 852ms, sequenceid=29, compaction requested=true 2023-07-11 17:53:31,107 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e3f02074d49896da91a4a986ed5a3926: 2023-07-11 17:53:31,108 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1689098002155.e3f02074d49896da91a4a986ed5a3926. 2023-07-11 17:53:31,108 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 17:53:31,108 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 17:53:31,108 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:31,109 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-07-11 17:53:31,109 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-07-11 17:53:31,111 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:31,112 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:31,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:31,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:53:31,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:53:31,112 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:31,112 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 17:53:31,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:53:31,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:53:31,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:31,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:31,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:53:31,114 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-07-11 17:53:31,114 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7cd56fcb[Count = 0] remaining members to acquire global barrier 2023-07-11 17:53:31,114 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-07-11 17:53:31,114 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:31,115 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:31,115 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:31,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:31,115 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-07-11 17:53:31,115 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-07-11 17:53:31,115 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase9.apache.org,45839,1689097999112' in zk 2023-07-11 17:53:31,115 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:31,116 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 17:53:31,117 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-07-11 17:53:31,117 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:31,117 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:53:31,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:31,117 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-07-11 17:53:31,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:53:31,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:53:31,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:53:31,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:53:31,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:31,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:31,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:53:31,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:31,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:31,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase9.apache.org,45839,1689097999112': 2023-07-11 17:53:31,120 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-07-11 17:53:31,120 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-07-11 17:53:31,120 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 17:53:31,120 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 17:53:31,120 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:31,120 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 17:53:31,122 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:31,122 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:31,122 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:53:31,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:31,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:53:31,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:53:31,122 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:31,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:31,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:53:31,123 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:53:31,123 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:31,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:53:31,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:31,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:31,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:53:31,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:31,124 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:31,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:31,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:53:31,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:31,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:31,130 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:31,130 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:31,130 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:53:31,130 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:53:31,130 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:31,130 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:53:31,130 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:53:31,130 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:31,130 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-07-11 17:53:31,131 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 17:53:31,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:53:31,130 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:31,131 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:31,131 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-07-11 17:53:31,131 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:31,131 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-07-11 17:53:31,131 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:53:31,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:53:31,131 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 17:53:31,231 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 17:53:31,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 17:53:31,240 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 17:53:31,242 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-07-11 17:53:31,242 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:31,243 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-07-11 17:53:31,243 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:53:31,243 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-07-11 17:53:31,243 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-07-11 17:53:31,244 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:31,244 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:31,245 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:53:31,245 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:31,245 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:53:31,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:53:31,245 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:31,246 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 17:53:31,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:31,246 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:31,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 17:53:31,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:31,246 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:31,247 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-07-11 17:53:31,247 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:31,247 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-07-11 17:53:31,247 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:53:31,247 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-07-11 17:53:31,247 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 17:53:31,247 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 17:53:31,247 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1689098002155.e3f02074d49896da91a4a986ed5a3926. 2023-07-11 17:53:31,247 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1689098002155.e3f02074d49896da91a4a986ed5a3926. started... 2023-07-11 17:53:31,248 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e3f02074d49896da91a4a986ed5a3926 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-11 17:53:31,267 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010362eebf3d50fa4439896d10f503c63e22 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2016010362eebf3d50fa4439896d10f503c63e22 2023-07-11 17:53:31,706 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e3f02074d49896da91a4a986ed5a3926/.tmp/family1/1485e45476bf4276bcca4fb47e9075bb 2023-07-11 17:53:31,715 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e3f02074d49896da91a4a986ed5a3926/.tmp/family1/1485e45476bf4276bcca4fb47e9075bb as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e3f02074d49896da91a4a986ed5a3926/family1/1485e45476bf4276bcca4fb47e9075bb 2023-07-11 17:53:31,724 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e3f02074d49896da91a4a986ed5a3926/family1/1485e45476bf4276bcca4fb47e9075bb, entries=1, sequenceid=33, filesize=5.0 K 2023-07-11 17:53:31,726 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e3f02074d49896da91a4a986ed5a3926 in 478ms, sequenceid=33, compaction requested=true 2023-07-11 17:53:31,726 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e3f02074d49896da91a4a986ed5a3926: 2023-07-11 17:53:31,726 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1689098002155.e3f02074d49896da91a4a986ed5a3926. 2023-07-11 17:53:31,726 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 17:53:31,727 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 17:53:31,727 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:31,727 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-07-11 17:53:31,727 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-07-11 17:53:31,730 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:31,730 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:31,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:31,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:53:31,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:53:31,730 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:31,731 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 17:53:31,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:53:31,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:53:31,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:31,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:31,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:53:31,733 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-07-11 17:53:31,733 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@52943566[Count = 0] remaining members to acquire global barrier 2023-07-11 17:53:31,733 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-07-11 17:53:31,733 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:31,734 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:31,734 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:31,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:31,735 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-07-11 17:53:31,735 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-07-11 17:53:31,735 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase9.apache.org,45839,1689097999112' in zk 2023-07-11 17:53:31,735 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:31,735 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 17:53:31,737 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-07-11 17:53:31,737 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:31,737 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:53:31,737 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-07-11 17:53:31,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:31,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:53:31,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:53:31,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:53:31,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:53:31,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:31,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:31,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:53:31,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:31,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:31,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase9.apache.org,45839,1689097999112': 2023-07-11 17:53:31,742 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-07-11 17:53:31,742 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-07-11 17:53:31,742 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 17:53:31,742 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 17:53:31,742 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:31,742 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 17:53:31,745 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:31,745 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:31,745 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:53:31,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:31,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:53:31,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:53:31,745 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:31,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:31,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:53:31,746 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:31,746 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:53:31,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:53:31,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:31,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:31,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:53:31,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:31,748 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:31,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:31,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:53:31,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:31,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:31,751 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:31,752 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:31,752 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:31,752 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:53:31,752 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-07-11 17:53:31,752 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 17:53:31,752 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:53:31,752 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:53:31,752 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-07-11 17:53:31,752 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:53:31,752 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:31,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:53:31,753 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:31,753 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:31,753 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:31,753 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-07-11 17:53:31,753 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 17:53:31,753 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:53:31,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:53:31,853 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 17:53:31,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 17:53:31,862 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 17:53:31,865 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-07-11 17:53:31,865 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:31,865 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-07-11 17:53:31,865 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:53:31,865 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-07-11 17:53:31,865 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-07-11 17:53:31,866 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:31,866 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:31,867 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:31,867 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:53:31,867 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:53:31,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:53:31,868 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:31,868 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 17:53:31,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:31,868 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:31,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 17:53:31,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:31,869 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:31,869 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-07-11 17:53:31,869 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:31,870 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-07-11 17:53:31,870 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:53:31,870 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-07-11 17:53:31,871 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 17:53:31,871 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 17:53:31,871 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1689098002155.e3f02074d49896da91a4a986ed5a3926. 2023-07-11 17:53:31,871 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1689098002155.e3f02074d49896da91a4a986ed5a3926. started... 2023-07-11 17:53:31,871 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e3f02074d49896da91a4a986ed5a3926 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-11 17:53:32,291 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015090741762cd9e6bb4a53b129fda693624190 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015090741762cd9e6bb4a53b129fda693624190 2023-07-11 17:53:32,701 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e3f02074d49896da91a4a986ed5a3926/.tmp/family1/281f2a0358684e0f8d2e1662b49b8a3d 2023-07-11 17:53:32,709 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e3f02074d49896da91a4a986ed5a3926/.tmp/family1/281f2a0358684e0f8d2e1662b49b8a3d as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e3f02074d49896da91a4a986ed5a3926/family1/281f2a0358684e0f8d2e1662b49b8a3d 2023-07-11 17:53:32,716 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e3f02074d49896da91a4a986ed5a3926/family1/281f2a0358684e0f8d2e1662b49b8a3d, entries=1, sequenceid=37, filesize=5.0 K 2023-07-11 17:53:32,718 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e3f02074d49896da91a4a986ed5a3926 in 847ms, sequenceid=37, compaction requested=true 2023-07-11 17:53:32,718 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e3f02074d49896da91a4a986ed5a3926: 2023-07-11 17:53:32,718 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1689098002155.e3f02074d49896da91a4a986ed5a3926. 2023-07-11 17:53:32,718 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 17:53:32,718 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 17:53:32,719 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:32,719 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-07-11 17:53:32,719 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-07-11 17:53:32,724 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:32,724 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:32,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:32,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:53:32,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:53:32,724 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:32,724 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 17:53:32,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:53:32,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:53:32,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:32,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:32,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:53:32,725 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-07-11 17:53:32,726 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7e168370[Count = 0] remaining members to acquire global barrier 2023-07-11 17:53:32,726 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-07-11 17:53:32,726 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:32,727 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:32,727 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:32,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:32,727 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-07-11 17:53:32,727 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-07-11 17:53:32,727 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase9.apache.org,45839,1689097999112' in zk 2023-07-11 17:53:32,727 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:32,727 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 17:53:32,728 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-07-11 17:53:32,728 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:32,728 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:53:32,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:32,729 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-07-11 17:53:32,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:53:32,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:53:32,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:53:32,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:53:32,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:32,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:32,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:53:32,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:32,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:32,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase9.apache.org,45839,1689097999112': 2023-07-11 17:53:32,732 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-07-11 17:53:32,732 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-07-11 17:53:32,732 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 17:53:32,732 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 17:53:32,732 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:32,732 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 17:53:32,734 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:32,734 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:32,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:32,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:53:32,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:53:32,734 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:32,734 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:53:32,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:32,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:53:32,734 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:53:32,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:53:32,734 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:32,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:32,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:32,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:53:32,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:32,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:32,736 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:32,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:53:32,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:32,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:32,739 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:32,739 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:32,739 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:32,739 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:53:32,739 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:32,739 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:53:32,739 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:32,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:53:32,739 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:32,739 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:32,742 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:53:32,742 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-07-11 17:53:32,742 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 17:53:32,742 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:53:32,742 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:53:32,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:53:32,743 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-07-11 17:53:32,743 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 17:53:32,843 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 17:53:32,844 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 17:53:32,852 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 17:53:32,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-07-11 17:53:32,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:32,854 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-07-11 17:53:32,854 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:53:32,855 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-07-11 17:53:32,855 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-07-11 17:53:32,855 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:32,855 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:32,858 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:53:32,858 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:32,858 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:53:32,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:53:32,858 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:32,858 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 17:53:32,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:32,859 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:32,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 17:53:32,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:32,859 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:32,859 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-07-11 17:53:32,859 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:32,860 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-07-11 17:53:32,860 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:53:32,861 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-07-11 17:53:32,861 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 17:53:32,861 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 17:53:32,861 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1689098002155.e3f02074d49896da91a4a986ed5a3926. 2023-07-11 17:53:32,861 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1689098002155.e3f02074d49896da91a4a986ed5a3926. started... 2023-07-11 17:53:32,861 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e3f02074d49896da91a4a986ed5a3926 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-11 17:53:33,284 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511202f40c1bb928c469d87faf25d00b3b094 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511202f40c1bb928c469d87faf25d00b3b094 2023-07-11 17:53:33,693 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e3f02074d49896da91a4a986ed5a3926/.tmp/family1/6f301a13a94748dab3c503baec2b4748 2023-07-11 17:53:33,702 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e3f02074d49896da91a4a986ed5a3926/.tmp/family1/6f301a13a94748dab3c503baec2b4748 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e3f02074d49896da91a4a986ed5a3926/family1/6f301a13a94748dab3c503baec2b4748 2023-07-11 17:53:33,708 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e3f02074d49896da91a4a986ed5a3926/family1/6f301a13a94748dab3c503baec2b4748, entries=1, sequenceid=41, filesize=5.0 K 2023-07-11 17:53:33,710 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e3f02074d49896da91a4a986ed5a3926 in 849ms, sequenceid=41, compaction requested=true 2023-07-11 17:53:33,710 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e3f02074d49896da91a4a986ed5a3926: 2023-07-11 17:53:33,710 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1689098002155.e3f02074d49896da91a4a986ed5a3926. 2023-07-11 17:53:33,710 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 17:53:33,710 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 17:53:33,710 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:33,710 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-07-11 17:53:33,710 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-07-11 17:53:33,712 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:33,712 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:33,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:33,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:53:33,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:53:33,713 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:33,713 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 17:53:33,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:53:33,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:53:33,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:33,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:33,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:53:33,714 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-07-11 17:53:33,714 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@370def7e[Count = 0] remaining members to acquire global barrier 2023-07-11 17:53:33,714 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-07-11 17:53:33,714 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:33,715 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:33,716 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:33,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:33,716 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-07-11 17:53:33,716 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-07-11 17:53:33,716 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:33,716 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 17:53:33,716 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase9.apache.org,45839,1689097999112' in zk 2023-07-11 17:53:33,721 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:33,721 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-07-11 17:53:33,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:33,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:53:33,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:53:33,721 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:53:33,722 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-07-11 17:53:33,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:53:33,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:53:33,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:33,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:33,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:53:33,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:33,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:33,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase9.apache.org,45839,1689097999112': 2023-07-11 17:53:33,725 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-07-11 17:53:33,725 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-07-11 17:53:33,725 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 17:53:33,725 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 17:53:33,725 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:33,725 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 17:53:33,727 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:33,727 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:33,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:33,727 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:33,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:53:33,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:53:33,727 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:53:33,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:33,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:53:33,728 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:33,728 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:53:33,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:53:33,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:33,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:33,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:53:33,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:33,729 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:33,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:33,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:53:33,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:33,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:33,732 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:33,732 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:33,732 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:53:33,732 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:33,732 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-07-11 17:53:33,732 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:33,732 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-07-11 17:53:33,732 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:53:33,732 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:53:33,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:53:33,732 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:53:33,732 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:33,732 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 17:53:33,733 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:33,733 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:33,733 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:53:33,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:53:33,733 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-07-11 17:53:33,733 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 17:53:33,833 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 17:53:33,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 17:53:33,840 DEBUG [Listener at localhost/43271] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-11 17:53:33,843 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:60354, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-11 17:53:33,845 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=36885] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:33,857 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-07-11 17:53:33,858 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=12, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-07-11 17:53:33,860 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=12, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1689098613860 2023-07-11 17:53:33,860 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-07-11 17:53:33,863 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-07-11 17:53:33,868 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthly' and column 'family1' 2023-07-11 17:53:33,868 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-07-11 17:53:33,868 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] zookeeper.ReadOnlyZKClient(139): Connect 0x1b15da1a to 127.0.0.1:50702 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 17:53:33,874 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5938a9b8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 17:53:33,876 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-07-11 17:53:34,774 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103381eec5501914e6997f5fd17eeda9c03 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160103381eec5501914e6997f5fd17eeda9c03 2023-07-11 17:53:34,775 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-07-11 17:53:34,794 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 17:53:34,795 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:59156, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 17:53:34,808 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-11 17:53:34,810 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:60366, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-11 17:53:34,849 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/436e6f1ee1824dd78b1f274b88498155 first=Optional[r3] last=Optional[r6] 2023-07-11 17:53:34,866 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1689098002155.e3f02074d49896da91a4a986ed5a3926., hostname=jenkins-hbase9.apache.org,45839,1689097999112, seqNum=2 for row with hfile group [{family1,hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/436e6f1ee1824dd78b1f274b88498155}] 2023-07-11 17:53:34,884 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(763): Validating hfile at hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/436e6f1ee1824dd78b1f274b88498155 for inclusion in e3f02074d49896da91a4a986ed5a3926/family1 2023-07-11 17:53:34,891 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-07-11 17:53:34,891 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(777): Region bounds: first= last= 2023-07-11 17:53:34,891 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HRegion(2446): Flush status journal for e3f02074d49896da91a4a986ed5a3926: 2023-07-11 17:53:34,892 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/436e6f1ee1824dd78b1f274b88498155 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__l07na4ihk5er984mi4daun0g202o84s7hpisccf3d3sh8ep7849ir9c44n16pi7e/family1/436e6f1ee1824dd78b1f274b88498155 2023-07-11 17:53:34,896 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__l07na4ihk5er984mi4daun0g202o84s7hpisccf3d3sh8ep7849ir9c44n16pi7e/family1/436e6f1ee1824dd78b1f274b88498155 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e3f02074d49896da91a4a986ed5a3926/family1/31fafe1cc2bf48b795a755804082bebe_SeqId_44_ 2023-07-11 17:53:34,897 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(849): Loaded HFile hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__l07na4ihk5er984mi4daun0g202o84s7hpisccf3d3sh8ep7849ir9c44n16pi7e/family1/436e6f1ee1824dd78b1f274b88498155 into e3f02074d49896da91a4a986ed5a3926/family1 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e3f02074d49896da91a4a986ed5a3926/family1/31fafe1cc2bf48b795a755804082bebe_SeqId_44_ - updating store file list. 2023-07-11 17:53:34,903 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(882): Loaded HFile hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e3f02074d49896da91a4a986ed5a3926/family1/31fafe1cc2bf48b795a755804082bebe_SeqId_44_ into e3f02074d49896da91a4a986ed5a3926/family1 2023-07-11 17:53:34,903 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(855): Successfully loaded hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__l07na4ihk5er984mi4daun0g202o84s7hpisccf3d3sh8ep7849ir9c44n16pi7e/family1/436e6f1ee1824dd78b1f274b88498155 into e3f02074d49896da91a4a986ed5a3926/family1 (new location: hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e3f02074d49896da91a4a986ed5a3926/family1/31fafe1cc2bf48b795a755804082bebe_SeqId_44_) 2023-07-11 17:53:34,904 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__l07na4ihk5er984mi4daun0g202o84s7hpisccf3d3sh8ep7849ir9c44n16pi7e/family1/436e6f1ee1824dd78b1f274b88498155 2023-07-11 17:53:34,906 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-07-11 17:53:34,912 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51357 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-07-11 17:53:34,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(1912): e3f02074d49896da91a4a986ed5a3926/family1 is initiating minor compaction 2023-07-11 17:53:34,915 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@298ec394; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-11 17:53:34,915 INFO [RS:0;jenkins-hbase9:45839-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of e3f02074d49896da91a4a986ed5a3926/family1 in testMajorCompactionWithWeeklyFollowedByMonthly,,1689098002155.e3f02074d49896da91a4a986ed5a3926. 2023-07-11 17:53:34,916 INFO [RS:0;jenkins-hbase9:45839-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e3f02074d49896da91a4a986ed5a3926/family1/fd6e90d2a376479083e3672021f11038, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e3f02074d49896da91a4a986ed5a3926/family1/365556570f004b2a8bd872ca45b2d3c4, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e3f02074d49896da91a4a986ed5a3926/family1/e78550397a16412c95860df9f769ec11, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e3f02074d49896da91a4a986ed5a3926/family1/fb7ae29957844f42aef8cc56714bb039, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e3f02074d49896da91a4a986ed5a3926/family1/b4fcb054f5814e7e86e9c0f85232fbcd, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e3f02074d49896da91a4a986ed5a3926/family1/164b9d1862074342b9c128666d36f9d3, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e3f02074d49896da91a4a986ed5a3926/family1/1485e45476bf4276bcca4fb47e9075bb, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e3f02074d49896da91a4a986ed5a3926/family1/281f2a0358684e0f8d2e1662b49b8a3d, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e3f02074d49896da91a4a986ed5a3926/family1/6f301a13a94748dab3c503baec2b4748, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e3f02074d49896da91a4a986ed5a3926/family1/31fafe1cc2bf48b795a755804082bebe_SeqId_44_] into tmpdir=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e3f02074d49896da91a4a986ed5a3926/.tmp, totalSize=50.2 K 2023-07-11 17:53:34,917 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] compactions.Compactor(207): Compacting fd6e90d2a376479083e3672021f11038, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-07-11 17:53:34,917 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] compactions.Compactor(207): Compacting 365556570f004b2a8bd872ca45b2d3c4, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-07-11 17:53:34,917 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] compactions.Compactor(207): Compacting e78550397a16412c95860df9f769ec11, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-07-11 17:53:34,917 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] compactions.Compactor(207): Compacting fb7ae29957844f42aef8cc56714bb039, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-07-11 17:53:34,917 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] compactions.Compactor(207): Compacting b4fcb054f5814e7e86e9c0f85232fbcd, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-07-11 17:53:34,917 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] compactions.Compactor(207): Compacting 164b9d1862074342b9c128666d36f9d3, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-07-11 17:53:34,917 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] compactions.Compactor(207): Compacting 1485e45476bf4276bcca4fb47e9075bb, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-07-11 17:53:34,917 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] compactions.Compactor(207): Compacting 281f2a0358684e0f8d2e1662b49b8a3d, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-07-11 17:53:34,917 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] compactions.Compactor(207): Compacting 6f301a13a94748dab3c503baec2b4748, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-07-11 17:53:34,917 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] compactions.Compactor(207): Compacting 31fafe1cc2bf48b795a755804082bebe_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-07-11 17:53:34,931 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-07-11 17:53:34,933 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 17:53:34,939 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015122810ac4a08d3064fe681929311e9799bc6 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015122810ac4a08d3064fe681929311e9799bc6 2023-07-11 17:53:34,941 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151231015842724497419d973d6924c74da6e1 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151231015842724497419d973d6924c74da6e1 2023-07-11 17:53:34,944 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160101ea0505e1e8484c018f21494e1b7f45bb to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160101ea0505e1e8484c018f21494e1b7f45bb 2023-07-11 17:53:34,945 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2016010362eebf3d50fa4439896d10f503c63e22 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2016010362eebf3d50fa4439896d10f503c63e22 2023-07-11 17:53:34,946 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 4 expired mob files are deleted 2023-07-11 17:53:34,946 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-07-11 17:53:34,946 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-07-11 17:53:34,946 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-07-11 17:53:34,947 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-07-11 17:53:34,947 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-07-11 17:53:34,947 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-07-11 17:53:34,947 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-07-11 17:53:34,947 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-07-11 17:53:34,947 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-07-11 17:53:34,971 INFO [RS:0;jenkins-hbase9:45839-shortCompactions-0] throttle.PressureAwareThroughputController(145): e3f02074d49896da91a4a986ed5a3926#family1#compaction#10 average throughput is 0.18 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-11 17:53:35,036 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205f07413806ada4beab8f14020d5ae27d4 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151205f07413806ada4beab8f14020d5ae27d4 2023-07-11 17:53:35,037 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-07-11 17:53:35,072 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/d95f9ece475742ed9191babcc2855734 first=Optional[r00] last=Optional[r2] 2023-07-11 17:53:35,073 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1689098002155.e3f02074d49896da91a4a986ed5a3926., hostname=jenkins-hbase9.apache.org,45839,1689097999112, seqNum=2 for row with hfile group [{family1,hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/d95f9ece475742ed9191babcc2855734}] 2023-07-11 17:53:35,075 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(763): Validating hfile at hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/d95f9ece475742ed9191babcc2855734 for inclusion in e3f02074d49896da91a4a986ed5a3926/family1 2023-07-11 17:53:35,079 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-07-11 17:53:35,079 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(777): Region bounds: first= last= 2023-07-11 17:53:35,079 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HRegion(2446): Flush status journal for e3f02074d49896da91a4a986ed5a3926: 2023-07-11 17:53:35,080 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/d95f9ece475742ed9191babcc2855734 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__gggs23ulngevu4hu9lda7r3to7dn62mtvkocjgaleqp6m4om3kg9t95jd9vcg7h5/family1/d95f9ece475742ed9191babcc2855734 2023-07-11 17:53:35,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__gggs23ulngevu4hu9lda7r3to7dn62mtvkocjgaleqp6m4om3kg9t95jd9vcg7h5/family1/d95f9ece475742ed9191babcc2855734 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e3f02074d49896da91a4a986ed5a3926/family1/ae89960745c9467caad676da07327460_SeqId_46_ 2023-07-11 17:53:35,085 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(849): Loaded HFile hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__gggs23ulngevu4hu9lda7r3to7dn62mtvkocjgaleqp6m4om3kg9t95jd9vcg7h5/family1/d95f9ece475742ed9191babcc2855734 into e3f02074d49896da91a4a986ed5a3926/family1 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e3f02074d49896da91a4a986ed5a3926/family1/ae89960745c9467caad676da07327460_SeqId_46_ - updating store file list. 2023-07-11 17:53:35,091 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(882): Loaded HFile hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e3f02074d49896da91a4a986ed5a3926/family1/ae89960745c9467caad676da07327460_SeqId_46_ into e3f02074d49896da91a4a986ed5a3926/family1 2023-07-11 17:53:35,091 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(855): Successfully loaded hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__gggs23ulngevu4hu9lda7r3to7dn62mtvkocjgaleqp6m4om3kg9t95jd9vcg7h5/family1/d95f9ece475742ed9191babcc2855734 into e3f02074d49896da91a4a986ed5a3926/family1 (new location: hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e3f02074d49896da91a4a986ed5a3926/family1/ae89960745c9467caad676da07327460_SeqId_46_) 2023-07-11 17:53:35,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__gggs23ulngevu4hu9lda7r3to7dn62mtvkocjgaleqp6m4om3kg9t95jd9vcg7h5/family1/d95f9ece475742ed9191babcc2855734 2023-07-11 17:53:35,094 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-07-11 17:53:35,096 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 17:53:35,098 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511303a92630b46d3400293b1ec3a0b8ef84e to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511303a92630b46d3400293b1ec3a0b8ef84e 2023-07-11 17:53:35,100 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512014f37b7050d1040a7b6f20d3835a0b152 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512014f37b7050d1040a7b6f20d3835a0b152 2023-07-11 17:53:35,101 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151205441d50a3727e4a49b8238e54656766f0 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151205441d50a3727e4a49b8238e54656766f0 2023-07-11 17:53:35,101 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 3 expired mob files are deleted 2023-07-11 17:53:35,101 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-07-11 17:53:35,102 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-07-11 17:53:35,102 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-07-11 17:53:35,103 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-07-11 17:53:35,103 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=12, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-07-11 17:53:35,105 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE in 1.2530 sec 2023-07-11 17:53:35,263 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.HMaster$12(2454): Client=jenkins//172.31.2.10 modify table testMajorCompactionWithWeeklyFollowedByMonthly from 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-07-11 17:53:35,271 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:35,401 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e3f02074d49896da91a4a986ed5a3926/.tmp/family1/6760e67aff364215b543b4298ef741aa as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e3f02074d49896da91a4a986ed5a3926/family1/6760e67aff364215b543b4298ef741aa 2023-07-11 17:53:35,415 INFO [RS:0;jenkins-hbase9:45839-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in e3f02074d49896da91a4a986ed5a3926/family1 of e3f02074d49896da91a4a986ed5a3926 into 6760e67aff364215b543b4298ef741aa(size=6.6 K), total size for store is 358.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-11 17:53:35,416 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for e3f02074d49896da91a4a986ed5a3926: 2023-07-11 17:53:35,417 INFO [RS:0;jenkins-hbase9:45839-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthly,,1689098002155.e3f02074d49896da91a4a986ed5a3926., storeName=family1, fileCount=10, fileSize=50.2 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.5 K), priority=2, time=1689098014913; duration=0sec 2023-07-11 17:53:35,418 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-11 17:53:35,445 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e3f02074d49896da91a4a986ed5a3926/family1/fd6e90d2a376479083e3672021f11038, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e3f02074d49896da91a4a986ed5a3926/family1/365556570f004b2a8bd872ca45b2d3c4, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e3f02074d49896da91a4a986ed5a3926/family1/e78550397a16412c95860df9f769ec11, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e3f02074d49896da91a4a986ed5a3926/family1/fb7ae29957844f42aef8cc56714bb039, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e3f02074d49896da91a4a986ed5a3926/family1/b4fcb054f5814e7e86e9c0f85232fbcd, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e3f02074d49896da91a4a986ed5a3926/family1/164b9d1862074342b9c128666d36f9d3, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e3f02074d49896da91a4a986ed5a3926/family1/1485e45476bf4276bcca4fb47e9075bb, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e3f02074d49896da91a4a986ed5a3926/family1/281f2a0358684e0f8d2e1662b49b8a3d, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e3f02074d49896da91a4a986ed5a3926/family1/6f301a13a94748dab3c503baec2b4748, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e3f02074d49896da91a4a986ed5a3926/family1/31fafe1cc2bf48b795a755804082bebe_SeqId_44_] to archive 2023-07-11 17:53:35,446 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 17:53:35,449 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e3f02074d49896da91a4a986ed5a3926/family1/fd6e90d2a376479083e3672021f11038 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e3f02074d49896da91a4a986ed5a3926/family1/fd6e90d2a376479083e3672021f11038 2023-07-11 17:53:35,450 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e3f02074d49896da91a4a986ed5a3926/family1/365556570f004b2a8bd872ca45b2d3c4 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e3f02074d49896da91a4a986ed5a3926/family1/365556570f004b2a8bd872ca45b2d3c4 2023-07-11 17:53:35,452 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e3f02074d49896da91a4a986ed5a3926/family1/e78550397a16412c95860df9f769ec11 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e3f02074d49896da91a4a986ed5a3926/family1/e78550397a16412c95860df9f769ec11 2023-07-11 17:53:35,453 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e3f02074d49896da91a4a986ed5a3926/family1/fb7ae29957844f42aef8cc56714bb039 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e3f02074d49896da91a4a986ed5a3926/family1/fb7ae29957844f42aef8cc56714bb039 2023-07-11 17:53:35,455 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e3f02074d49896da91a4a986ed5a3926/family1/b4fcb054f5814e7e86e9c0f85232fbcd to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e3f02074d49896da91a4a986ed5a3926/family1/b4fcb054f5814e7e86e9c0f85232fbcd 2023-07-11 17:53:35,456 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e3f02074d49896da91a4a986ed5a3926/family1/164b9d1862074342b9c128666d36f9d3 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e3f02074d49896da91a4a986ed5a3926/family1/164b9d1862074342b9c128666d36f9d3 2023-07-11 17:53:35,458 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e3f02074d49896da91a4a986ed5a3926/family1/1485e45476bf4276bcca4fb47e9075bb to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e3f02074d49896da91a4a986ed5a3926/family1/1485e45476bf4276bcca4fb47e9075bb 2023-07-11 17:53:35,459 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e3f02074d49896da91a4a986ed5a3926/family1/281f2a0358684e0f8d2e1662b49b8a3d to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e3f02074d49896da91a4a986ed5a3926/family1/281f2a0358684e0f8d2e1662b49b8a3d 2023-07-11 17:53:35,461 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e3f02074d49896da91a4a986ed5a3926/family1/6f301a13a94748dab3c503baec2b4748 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e3f02074d49896da91a4a986ed5a3926/family1/6f301a13a94748dab3c503baec2b4748 2023-07-11 17:53:35,462 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e3f02074d49896da91a4a986ed5a3926/family1/31fafe1cc2bf48b795a755804082bebe_SeqId_44_ to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e3f02074d49896da91a4a986ed5a3926/family1/31fafe1cc2bf48b795a755804082bebe_SeqId_44_ 2023-07-11 17:53:35,688 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000002 2023-07-11 17:53:35,690 DEBUG [PEWorker-1] util.FSTableDescriptors(519): Deleted hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000001 2023-07-11 17:53:35,690 INFO [PEWorker-1] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000002 2023-07-11 17:53:35,695 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=14, ppid=13, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly}] 2023-07-11 17:53:35,707 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=e3f02074d49896da91a4a986ed5a3926, REOPEN/MOVE}] 2023-07-11 17:53:35,710 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=e3f02074d49896da91a4a986ed5a3926, REOPEN/MOVE 2023-07-11 17:53:35,711 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=e3f02074d49896da91a4a986ed5a3926, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:35,711 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1689098002155.e3f02074d49896da91a4a986ed5a3926.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1689098015711"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689098015711"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689098015711"}]},"ts":"1689098015711"} 2023-07-11 17:53:35,714 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE; CloseRegionProcedure e3f02074d49896da91a4a986ed5a3926, server=jenkins-hbase9.apache.org,45839,1689097999112}] 2023-07-11 17:53:35,875 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close e3f02074d49896da91a4a986ed5a3926 2023-07-11 17:53:35,875 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing e3f02074d49896da91a4a986ed5a3926, disabling compactions & flushes 2023-07-11 17:53:35,875 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1689098002155.e3f02074d49896da91a4a986ed5a3926. 2023-07-11 17:53:35,875 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1689098002155.e3f02074d49896da91a4a986ed5a3926. 2023-07-11 17:53:35,875 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1689098002155.e3f02074d49896da91a4a986ed5a3926. after waiting 0 ms 2023-07-11 17:53:35,875 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1689098002155.e3f02074d49896da91a4a986ed5a3926. 2023-07-11 17:53:35,884 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e3f02074d49896da91a4a986ed5a3926/recovered.edits/49.seqid, newMaxSeqId=49, maxSeqId=1 2023-07-11 17:53:35,885 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1689098002155.e3f02074d49896da91a4a986ed5a3926. 2023-07-11 17:53:35,885 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for e3f02074d49896da91a4a986ed5a3926: 2023-07-11 17:53:35,885 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(3510): Not adding moved region record: e3f02074d49896da91a4a986ed5a3926 to self. 2023-07-11 17:53:35,887 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed e3f02074d49896da91a4a986ed5a3926 2023-07-11 17:53:35,888 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=e3f02074d49896da91a4a986ed5a3926, regionState=CLOSED 2023-07-11 17:53:35,888 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1689098002155.e3f02074d49896da91a4a986ed5a3926.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1689098015888"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689098015888"}]},"ts":"1689098015888"} 2023-07-11 17:53:35,893 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-07-11 17:53:35,893 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; CloseRegionProcedure e3f02074d49896da91a4a986ed5a3926, server=jenkins-hbase9.apache.org,45839,1689097999112 in 176 msec 2023-07-11 17:53:35,894 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=e3f02074d49896da91a4a986ed5a3926, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase9.apache.org,45839,1689097999112; forceNewPlan=false, retain=true 2023-07-11 17:53:36,044 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=e3f02074d49896da91a4a986ed5a3926, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:36,044 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1689098002155.e3f02074d49896da91a4a986ed5a3926.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1689098016044"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689098016044"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689098016044"}]},"ts":"1689098016044"} 2023-07-11 17:53:36,047 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=15, state=RUNNABLE; OpenRegionProcedure e3f02074d49896da91a4a986ed5a3926, server=jenkins-hbase9.apache.org,45839,1689097999112}] 2023-07-11 17:53:36,203 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthly,,1689098002155.e3f02074d49896da91a4a986ed5a3926. 2023-07-11 17:53:36,203 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e3f02074d49896da91a4a986ed5a3926, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1689098002155.e3f02074d49896da91a4a986ed5a3926.', STARTKEY => '', ENDKEY => ''} 2023-07-11 17:53:36,203 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthly e3f02074d49896da91a4a986ed5a3926 2023-07-11 17:53:36,204 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1689098002155.e3f02074d49896da91a4a986ed5a3926.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 17:53:36,204 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for e3f02074d49896da91a4a986ed5a3926 2023-07-11 17:53:36,204 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for e3f02074d49896da91a4a986ed5a3926 2023-07-11 17:53:36,205 INFO [StoreOpener-e3f02074d49896da91a4a986ed5a3926-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region e3f02074d49896da91a4a986ed5a3926 2023-07-11 17:53:36,206 DEBUG [StoreOpener-e3f02074d49896da91a4a986ed5a3926-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e3f02074d49896da91a4a986ed5a3926/family1 2023-07-11 17:53:36,206 DEBUG [StoreOpener-e3f02074d49896da91a4a986ed5a3926-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e3f02074d49896da91a4a986ed5a3926/family1 2023-07-11 17:53:36,207 INFO [StoreOpener-e3f02074d49896da91a4a986ed5a3926-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e3f02074d49896da91a4a986ed5a3926 columnFamilyName family1 2023-07-11 17:53:36,217 DEBUG [StoreOpener-e3f02074d49896da91a4a986ed5a3926-1] regionserver.HStore(539): loaded hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e3f02074d49896da91a4a986ed5a3926/family1/6760e67aff364215b543b4298ef741aa 2023-07-11 17:53:36,224 DEBUG [StoreOpener-e3f02074d49896da91a4a986ed5a3926-1] regionserver.HStore(539): loaded hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e3f02074d49896da91a4a986ed5a3926/family1/ae89960745c9467caad676da07327460_SeqId_46_ 2023-07-11 17:53:36,228 DEBUG [StoreOpener-e3f02074d49896da91a4a986ed5a3926-1] regionserver.HStore(539): loaded hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e3f02074d49896da91a4a986ed5a3926/family1/c4a01f29d2dc4888ae763621af859873 2023-07-11 17:53:36,229 INFO [StoreOpener-e3f02074d49896da91a4a986ed5a3926-1] regionserver.HStore(310): Store=e3f02074d49896da91a4a986ed5a3926/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 17:53:36,230 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e3f02074d49896da91a4a986ed5a3926 2023-07-11 17:53:36,231 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e3f02074d49896da91a4a986ed5a3926 2023-07-11 17:53:36,235 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for e3f02074d49896da91a4a986ed5a3926 2023-07-11 17:53:36,236 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened e3f02074d49896da91a4a986ed5a3926; next sequenceid=50; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74351980, jitterRate=0.10793083906173706}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 17:53:36,237 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for e3f02074d49896da91a4a986ed5a3926: 2023-07-11 17:53:36,238 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthly,,1689098002155.e3f02074d49896da91a4a986ed5a3926., pid=17, masterSystemTime=1689098016199 2023-07-11 17:53:36,238 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-11 17:53:36,239 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-07-11 17:53:36,241 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 367249 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-07-11 17:53:36,241 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] regionserver.HStore(1912): e3f02074d49896da91a4a986ed5a3926/family1 is initiating minor compaction (all files) 2023-07-11 17:53:36,242 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthly,,1689098002155.e3f02074d49896da91a4a986ed5a3926. 2023-07-11 17:53:36,242 INFO [RS:0;jenkins-hbase9:45839-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of e3f02074d49896da91a4a986ed5a3926/family1 in testMajorCompactionWithWeeklyFollowedByMonthly,,1689098002155.e3f02074d49896da91a4a986ed5a3926. 2023-07-11 17:53:36,242 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthly,,1689098002155.e3f02074d49896da91a4a986ed5a3926. 2023-07-11 17:53:36,242 INFO [RS:0;jenkins-hbase9:45839-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e3f02074d49896da91a4a986ed5a3926/family1/c4a01f29d2dc4888ae763621af859873, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e3f02074d49896da91a4a986ed5a3926/family1/6760e67aff364215b543b4298ef741aa, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e3f02074d49896da91a4a986ed5a3926/family1/ae89960745c9467caad676da07327460_SeqId_46_] into tmpdir=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e3f02074d49896da91a4a986ed5a3926/.tmp, totalSize=358.6 K 2023-07-11 17:53:36,242 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=e3f02074d49896da91a4a986ed5a3926, regionState=OPEN, openSeqNum=50, regionLocation=jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:36,243 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] compactions.Compactor(207): Compacting c4a01f29d2dc4888ae763621af859873, keycount=1000, bloomtype=ROW, size=175.8 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878822106 2023-07-11 17:53:36,243 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1689098002155.e3f02074d49896da91a4a986ed5a3926.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1689098016242"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689098016242"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689098016242"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689098016242"}]},"ts":"1689098016242"} 2023-07-11 17:53:36,243 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] compactions.Compactor(207): Compacting 6760e67aff364215b543b4298ef741aa, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621222106 2023-07-11 17:53:36,244 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] compactions.Compactor(207): Compacting ae89960745c9467caad676da07327460_SeqId_46_, keycount=1002, bloomtype=ROW, size=176.2 K, encoding=NONE, compression=NONE, seqNum=47, earliestPutTs=1448878822106 2023-07-11 17:53:36,247 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=15 2023-07-11 17:53:36,247 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=15, state=SUCCESS; OpenRegionProcedure e3f02074d49896da91a4a986ed5a3926, server=jenkins-hbase9.apache.org,45839,1689097999112 in 198 msec 2023-07-11 17:53:36,250 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=14 2023-07-11 17:53:36,250 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=14, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=e3f02074d49896da91a4a986ed5a3926, REOPEN/MOVE in 540 msec 2023-07-11 17:53:36,255 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=14, resume processing ppid=13 2023-07-11 17:53:36,255 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=13, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 559 msec 2023-07-11 17:53:36,258 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 990 msec 2023-07-11 17:53:36,261 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1230): Checking to see if procedure is done pid=13 2023-07-11 17:53:36,270 INFO [Listener at localhost/43271] compactions.TestMobCompactor(278): alter status finished 2023-07-11 17:53:36,272 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=36885] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthly 2023-07-11 17:53:36,273 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-07-11 17:53:36,274 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-07-11 17:53:36,276 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-07-11 17:53:36,276 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1689098616275 2023-07-11 17:53:36,277 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-07-11 17:53:36,277 INFO [RS:0;jenkins-hbase9:45839-shortCompactions-0] throttle.PressureAwareThroughputController(145): e3f02074d49896da91a4a986ed5a3926#family1#compaction#11 average throughput is 7.51 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-11 17:53:36,277 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthly' and column 'family1' 2023-07-11 17:53:36,284 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-07-11 17:53:36,284 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] zookeeper.ReadOnlyZKClient(139): Connect 0x5de972d1 to 127.0.0.1:50702 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 17:53:36,296 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@44bca9bd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 17:53:36,296 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-07-11 17:53:36,297 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-07-11 17:53:36,297 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-07-11 17:53:36,297 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-07-11 17:53:36,297 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-07-11 17:53:37,134 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128eaa7b60318024e818f9d9bdc9f1bc5bd to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151128eaa7b60318024e818f9d9bdc9f1bc5bd 2023-07-11 17:53:37,136 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-07-11 17:53:37,149 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 17:53:37,150 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:59168, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 17:53:37,158 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-11 17:53:37,160 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:60374, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-11 17:53:37,171 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/fd467bd7bf8b443dbf76b0bd6ddaf54e first=Optional[r05] last=Optional[r8] 2023-07-11 17:53:37,172 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1689098002155.e3f02074d49896da91a4a986ed5a3926., hostname=jenkins-hbase9.apache.org,45839,1689097999112, seqNum=50 for row with hfile group [{family1,hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/fd467bd7bf8b443dbf76b0bd6ddaf54e}] 2023-07-11 17:53:37,177 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(763): Validating hfile at hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/fd467bd7bf8b443dbf76b0bd6ddaf54e for inclusion in e3f02074d49896da91a4a986ed5a3926/family1 2023-07-11 17:53:37,180 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-07-11 17:53:37,180 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(777): Region bounds: first= last= 2023-07-11 17:53:37,180 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HRegion(2446): Flush status journal for e3f02074d49896da91a4a986ed5a3926: 2023-07-11 17:53:37,181 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/fd467bd7bf8b443dbf76b0bd6ddaf54e to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__bd42l49f6dblk1m9jvhpgsbjod6honvmgcsn85grm3ga3098pe53po2u959tgqc9/family1/fd467bd7bf8b443dbf76b0bd6ddaf54e 2023-07-11 17:53:37,185 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__bd42l49f6dblk1m9jvhpgsbjod6honvmgcsn85grm3ga3098pe53po2u959tgqc9/family1/fd467bd7bf8b443dbf76b0bd6ddaf54e as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e3f02074d49896da91a4a986ed5a3926/family1/5d2f26c08ef3486bb71f0b8202380f60_SeqId_52_ 2023-07-11 17:53:37,185 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(849): Loaded HFile hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__bd42l49f6dblk1m9jvhpgsbjod6honvmgcsn85grm3ga3098pe53po2u959tgqc9/family1/fd467bd7bf8b443dbf76b0bd6ddaf54e into e3f02074d49896da91a4a986ed5a3926/family1 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e3f02074d49896da91a4a986ed5a3926/family1/5d2f26c08ef3486bb71f0b8202380f60_SeqId_52_ - updating store file list. 2023-07-11 17:53:37,192 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(882): Loaded HFile hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e3f02074d49896da91a4a986ed5a3926/family1/5d2f26c08ef3486bb71f0b8202380f60_SeqId_52_ into e3f02074d49896da91a4a986ed5a3926/family1 2023-07-11 17:53:37,192 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(855): Successfully loaded hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__bd42l49f6dblk1m9jvhpgsbjod6honvmgcsn85grm3ga3098pe53po2u959tgqc9/family1/fd467bd7bf8b443dbf76b0bd6ddaf54e into e3f02074d49896da91a4a986ed5a3926/family1 (new location: hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e3f02074d49896da91a4a986ed5a3926/family1/5d2f26c08ef3486bb71f0b8202380f60_SeqId_52_) 2023-07-11 17:53:37,192 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__bd42l49f6dblk1m9jvhpgsbjod6honvmgcsn85grm3ga3098pe53po2u959tgqc9/family1/fd467bd7bf8b443dbf76b0bd6ddaf54e 2023-07-11 17:53:37,195 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-07-11 17:53:37,196 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 17:53:37,197 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511202f40c1bb928c469d87faf25d00b3b094 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511202f40c1bb928c469d87faf25d00b3b094 2023-07-11 17:53:37,199 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151128d4b03672aaf646cd96ff1adf2bb243bc to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151128d4b03672aaf646cd96ff1adf2bb243bc 2023-07-11 17:53:37,199 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 2 expired mob files are deleted 2023-07-11 17:53:37,199 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-07-11 17:53:37,200 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-07-11 17:53:37,200 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-07-11 17:53:37,200 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-07-11 17:53:37,200 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-07-11 17:53:37,200 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-07-11 17:53:37,201 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-07-11 17:53:37,203 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE in 929 msec 2023-07-11 17:53:37,307 INFO [Listener at localhost/43271] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthly Thread=250 (was 212) Potentially hanging thread: hconnection-0x33ab6555-shared-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2145606250_17 at /127.0.0.1:54330 [Waiting for operation #15] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:50702@0x5de972d1-SendThread(127.0.0.1:50702) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: hconnection-0x6cf667c-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2145606250_17 at /127.0.0.1:54208 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'HBase' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:50702@0x1b15da1a-SendThread(127.0.0.1:50702) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2145606250_17 at /127.0.0.1:54340 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS:0;jenkins-hbase9:45839-shortCompactions-0 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.DFSOutputStream.completeFile(DFSOutputStream.java:940) org.apache.hadoop.hdfs.DFSOutputStream.completeFile(DFSOutputStream.java:880) org.apache.hadoop.hdfs.DFSOutputStream.closeImpl(DFSOutputStream.java:863) org.apache.hadoop.hdfs.DFSOutputStream.close(DFSOutputStream.java:818) org.apache.hadoop.fs.FSDataOutputStream$PositionCache.close(FSDataOutputStream.java:72) org.apache.hadoop.fs.FSDataOutputStream.close(FSDataOutputStream.java:106) org.apache.hadoop.hbase.io.hfile.HFileWriterImpl.finishClose(HFileWriterImpl.java:820) org.apache.hadoop.hbase.io.hfile.HFileWriterImpl.close(HFileWriterImpl.java:654) org.apache.hadoop.hbase.regionserver.StoreFileWriter.close(StoreFileWriter.java:359) org.apache.hadoop.hbase.regionserver.compactions.DefaultCompactor.commitWriter(DefaultCompactor.java:89) org.apache.hadoop.hbase.regionserver.compactions.DefaultCompactor.commitWriter(DefaultCompactor.java:42) org.apache.hadoop.hbase.regionserver.compactions.Compactor.compact(Compactor.java:362) org.apache.hadoop.hbase.mob.DefaultMobStoreCompactor.compact(DefaultMobStoreCompactor.java:108) org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext.compact(DefaultStoreEngine.java:122) org.apache.hadoop.hbase.regionserver.HStore.compact(HStore.java:1473) org.apache.hadoop.hbase.regionserver.HRegion.compact(HRegion.java:2267) org.apache.hadoop.hbase.regionserver.CompactSplit$CompactionRunner.doCompaction(CompactSplit.java:625) org.apache.hadoop.hbase.regionserver.CompactSplit$CompactionRunner.run(CompactSplit.java:673) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:50702@0x5de972d1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$46/980716329.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:50702@0x1b15da1a sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$46/980716329.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hfile_cleaner-dir-scan-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:50702@0x5de972d1-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2145606250_17 at /127.0.0.1:54224 [Waiting for operation #12] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RSProcedureDispatcher-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2145606250_17 at /127.0.0.1:54276 [Waiting for operation #12] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2145606250_17 at /127.0.0.1:54314 [Waiting for operation #19] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2145606250_17 at /127.0.0.1:54178 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6cf667c-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:50702@0x1b15da1a-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2145606250_17 at /127.0.0.1:54286 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataStreamer for file /user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e3f02074d49896da91a4a986ed5a3926/.tmp/family1/95d0d30f77724299a585b59dc38620a6 java.lang.Object.wait(Native Method) org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:678) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2145606250_17 at /127.0.0.1:54298 [Waiting for operation #13] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x33ab6555-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6cf667c-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x33ab6555-shared-pool-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hfile_cleaner-dir-scan-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x33ab6555-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-643365118_17 at /127.0.0.1:54164 [Waiting for operation #16] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2145606250_17 at /127.0.0.1:54404 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2145606250_17 at /127.0.0.1:54388 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2145606250_17 at /127.0.0.1:54242 [Waiting for operation #24] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x33ab6555-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobCompactor-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2145606250_17 at /127.0.0.1:54312 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=589 (was 478) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=231 (was 237), ProcessCount=170 (was 170), AvailableMemoryMB=8897 (was 9114) 2023-07-11 17:53:37,320 INFO [Listener at localhost/43271] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithMonthlyPolicy Thread=250, OpenFileDescriptor=589, MaxFileDescriptor=60000, SystemLoadAverage=231, ProcessCount=170, AvailableMemoryMB=8896 2023-07-11 17:53:37,322 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testMajorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-07-11 17:53:37,323 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:37,325 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-07-11 17:53:37,325 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithMonthlyPolicy" procId is: 19 2023-07-11 17:53:37,326 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-11 17:53:37,326 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-07-11 17:53:37,327 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/79dd09a662e99a3de62daf35d6a0df12 2023-07-11 17:53:37,328 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/79dd09a662e99a3de62daf35d6a0df12 empty. 2023-07-11 17:53:37,329 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/79dd09a662e99a3de62daf35d6a0df12 2023-07-11 17:53:37,329 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithMonthlyPolicy regions 2023-07-11 17:53:37,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-07-11 17:53:37,516 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e3f02074d49896da91a4a986ed5a3926/.tmp/family1/95d0d30f77724299a585b59dc38620a6 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e3f02074d49896da91a4a986ed5a3926/family1/95d0d30f77724299a585b59dc38620a6 2023-07-11 17:53:37,523 INFO [RS:0;jenkins-hbase9:45839-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in e3f02074d49896da91a4a986ed5a3926/family1 of e3f02074d49896da91a4a986ed5a3926 into 95d0d30f77724299a585b59dc38620a6(size=177.2 K), total size for store is 182.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-07-11 17:53:37,523 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for e3f02074d49896da91a4a986ed5a3926: 2023-07-11 17:53:37,523 INFO [RS:0;jenkins-hbase9:45839-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testMajorCompactionWithWeeklyFollowedByMonthly,,1689098002155.e3f02074d49896da91a4a986ed5a3926., storeName=e3f02074d49896da91a4a986ed5a3926/family1, priority=13, startTime=1689098016238; duration=1sec 2023-07-11 17:53:37,523 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-11 17:53:37,538 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e3f02074d49896da91a4a986ed5a3926/family1/c4a01f29d2dc4888ae763621af859873, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e3f02074d49896da91a4a986ed5a3926/family1/6760e67aff364215b543b4298ef741aa, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e3f02074d49896da91a4a986ed5a3926/family1/ae89960745c9467caad676da07327460_SeqId_46_] to archive 2023-07-11 17:53:37,539 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 17:53:37,542 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e3f02074d49896da91a4a986ed5a3926/family1/c4a01f29d2dc4888ae763621af859873 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e3f02074d49896da91a4a986ed5a3926/family1/c4a01f29d2dc4888ae763621af859873 2023-07-11 17:53:37,543 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e3f02074d49896da91a4a986ed5a3926/family1/6760e67aff364215b543b4298ef741aa to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e3f02074d49896da91a4a986ed5a3926/family1/6760e67aff364215b543b4298ef741aa 2023-07-11 17:53:37,545 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e3f02074d49896da91a4a986ed5a3926/family1/ae89960745c9467caad676da07327460_SeqId_46_ to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e3f02074d49896da91a4a986ed5a3926/family1/ae89960745c9467caad676da07327460_SeqId_46_ 2023-07-11 17:53:37,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-07-11 17:53:37,739 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/.tabledesc/.tableinfo.0000000001 2023-07-11 17:53:37,740 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => 79dd09a662e99a3de62daf35d6a0df12, NAME => 'testMajorCompactionWithMonthlyPolicy,,1689098017322.79dd09a662e99a3de62daf35d6a0df12.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}, regionDir=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/.tmp 2023-07-11 17:53:37,756 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithMonthlyPolicy,,1689098017322.79dd09a662e99a3de62daf35d6a0df12.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 17:53:37,756 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1604): Closing 79dd09a662e99a3de62daf35d6a0df12, disabling compactions & flushes 2023-07-11 17:53:37,756 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithMonthlyPolicy,,1689098017322.79dd09a662e99a3de62daf35d6a0df12. 2023-07-11 17:53:37,756 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithMonthlyPolicy,,1689098017322.79dd09a662e99a3de62daf35d6a0df12. 2023-07-11 17:53:37,756 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithMonthlyPolicy,,1689098017322.79dd09a662e99a3de62daf35d6a0df12. after waiting 0 ms 2023-07-11 17:53:37,756 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithMonthlyPolicy,,1689098017322.79dd09a662e99a3de62daf35d6a0df12. 2023-07-11 17:53:37,756 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithMonthlyPolicy,,1689098017322.79dd09a662e99a3de62daf35d6a0df12. 2023-07-11 17:53:37,756 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for 79dd09a662e99a3de62daf35d6a0df12: 2023-07-11 17:53:37,760 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-07-11 17:53:37,761 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithMonthlyPolicy,,1689098017322.79dd09a662e99a3de62daf35d6a0df12.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1689098017761"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689098017761"}]},"ts":"1689098017761"} 2023-07-11 17:53:37,763 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-11 17:53:37,765 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-11 17:53:37,765 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689098017765"}]},"ts":"1689098017765"} 2023-07-11 17:53:37,767 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithMonthlyPolicy, state=ENABLING in hbase:meta 2023-07-11 17:53:37,771 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=79dd09a662e99a3de62daf35d6a0df12, ASSIGN}] 2023-07-11 17:53:37,773 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=79dd09a662e99a3de62daf35d6a0df12, ASSIGN 2023-07-11 17:53:37,774 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=79dd09a662e99a3de62daf35d6a0df12, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,45839,1689097999112; forceNewPlan=false, retain=false 2023-07-11 17:53:37,925 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=79dd09a662e99a3de62daf35d6a0df12, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:37,926 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithMonthlyPolicy,,1689098017322.79dd09a662e99a3de62daf35d6a0df12.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1689098017925"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689098017925"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689098017925"}]},"ts":"1689098017925"} 2023-07-11 17:53:37,928 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=20, state=RUNNABLE; OpenRegionProcedure 79dd09a662e99a3de62daf35d6a0df12, server=jenkins-hbase9.apache.org,45839,1689097999112}] 2023-07-11 17:53:37,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-07-11 17:53:38,084 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithMonthlyPolicy,,1689098017322.79dd09a662e99a3de62daf35d6a0df12. 2023-07-11 17:53:38,084 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 79dd09a662e99a3de62daf35d6a0df12, NAME => 'testMajorCompactionWithMonthlyPolicy,,1689098017322.79dd09a662e99a3de62daf35d6a0df12.', STARTKEY => '', ENDKEY => ''} 2023-07-11 17:53:38,084 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithMonthlyPolicy 79dd09a662e99a3de62daf35d6a0df12 2023-07-11 17:53:38,085 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithMonthlyPolicy,,1689098017322.79dd09a662e99a3de62daf35d6a0df12.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 17:53:38,085 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 79dd09a662e99a3de62daf35d6a0df12 2023-07-11 17:53:38,085 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 79dd09a662e99a3de62daf35d6a0df12 2023-07-11 17:53:38,086 INFO [StoreOpener-79dd09a662e99a3de62daf35d6a0df12-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 79dd09a662e99a3de62daf35d6a0df12 2023-07-11 17:53:38,087 DEBUG [StoreOpener-79dd09a662e99a3de62daf35d6a0df12-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithMonthlyPolicy/79dd09a662e99a3de62daf35d6a0df12/family1 2023-07-11 17:53:38,088 DEBUG [StoreOpener-79dd09a662e99a3de62daf35d6a0df12-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithMonthlyPolicy/79dd09a662e99a3de62daf35d6a0df12/family1 2023-07-11 17:53:38,088 INFO [StoreOpener-79dd09a662e99a3de62daf35d6a0df12-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 79dd09a662e99a3de62daf35d6a0df12 columnFamilyName family1 2023-07-11 17:53:38,090 INFO [StoreOpener-79dd09a662e99a3de62daf35d6a0df12-1] regionserver.HStore(310): Store=79dd09a662e99a3de62daf35d6a0df12/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 17:53:38,091 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithMonthlyPolicy/79dd09a662e99a3de62daf35d6a0df12 2023-07-11 17:53:38,091 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithMonthlyPolicy/79dd09a662e99a3de62daf35d6a0df12 2023-07-11 17:53:38,095 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 79dd09a662e99a3de62daf35d6a0df12 2023-07-11 17:53:38,097 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithMonthlyPolicy/79dd09a662e99a3de62daf35d6a0df12/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 17:53:38,098 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 79dd09a662e99a3de62daf35d6a0df12; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69162857, jitterRate=0.03060688078403473}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 17:53:38,098 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 79dd09a662e99a3de62daf35d6a0df12: 2023-07-11 17:53:38,099 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithMonthlyPolicy,,1689098017322.79dd09a662e99a3de62daf35d6a0df12., pid=21, masterSystemTime=1689098018080 2023-07-11 17:53:38,100 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithMonthlyPolicy,,1689098017322.79dd09a662e99a3de62daf35d6a0df12. 2023-07-11 17:53:38,101 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithMonthlyPolicy,,1689098017322.79dd09a662e99a3de62daf35d6a0df12. 2023-07-11 17:53:38,101 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=79dd09a662e99a3de62daf35d6a0df12, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:38,101 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithMonthlyPolicy,,1689098017322.79dd09a662e99a3de62daf35d6a0df12.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1689098018101"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689098018101"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689098018101"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689098018101"}]},"ts":"1689098018101"} 2023-07-11 17:53:38,105 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=20 2023-07-11 17:53:38,105 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=20, state=SUCCESS; OpenRegionProcedure 79dd09a662e99a3de62daf35d6a0df12, server=jenkins-hbase9.apache.org,45839,1689097999112 in 175 msec 2023-07-11 17:53:38,107 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=20, resume processing ppid=19 2023-07-11 17:53:38,107 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=19, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=79dd09a662e99a3de62daf35d6a0df12, ASSIGN in 334 msec 2023-07-11 17:53:38,108 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-11 17:53:38,108 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689098018108"}]},"ts":"1689098018108"} 2023-07-11 17:53:38,110 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithMonthlyPolicy, state=ENABLED in hbase:meta 2023-07-11 17:53:38,112 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-07-11 17:53:38,114 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy in 790 msec 2023-07-11 17:53:38,362 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithMonthlyPolicy' 2023-07-11 17:53:38,432 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-07-11 17:53:38,432 INFO [Listener at localhost/43271] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithMonthlyPolicy, procId: 19 completed 2023-07-11 17:53:38,469 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 17:53:38,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:38,472 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-07-11 17:53:38,473 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:53:38,473 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-07-11 17:53:38,473 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-07-11 17:53:38,474 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:38,474 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:38,475 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:53:38,475 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:38,475 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:53:38,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:53:38,475 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:38,476 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 17:53:38,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:38,476 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:38,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 17:53:38,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:38,476 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:38,477 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:38,477 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-07-11 17:53:38,477 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:53:38,477 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-07-11 17:53:38,477 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 17:53:38,478 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 17:53:38,478 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1689098017322.79dd09a662e99a3de62daf35d6a0df12. 2023-07-11 17:53:38,478 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1689098017322.79dd09a662e99a3de62daf35d6a0df12. started... 2023-07-11 17:53:38,478 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 79dd09a662e99a3de62daf35d6a0df12 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-07-11 17:53:38,500 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511306ab0d93542a247ea90bb30a8bbe51743 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511306ab0d93542a247ea90bb30a8bbe51743 2023-07-11 17:53:38,905 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithMonthlyPolicy/79dd09a662e99a3de62daf35d6a0df12/.tmp/family1/021a0b89ab7640c49eebb9eb6ce83709 2023-07-11 17:53:38,912 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithMonthlyPolicy/79dd09a662e99a3de62daf35d6a0df12/.tmp/family1/021a0b89ab7640c49eebb9eb6ce83709 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithMonthlyPolicy/79dd09a662e99a3de62daf35d6a0df12/family1/021a0b89ab7640c49eebb9eb6ce83709 2023-07-11 17:53:38,918 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithMonthlyPolicy/79dd09a662e99a3de62daf35d6a0df12/family1/021a0b89ab7640c49eebb9eb6ce83709, entries=1000, sequenceid=5, filesize=166.0 K 2023-07-11 17:53:38,920 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 79dd09a662e99a3de62daf35d6a0df12 in 442ms, sequenceid=5, compaction requested=false 2023-07-11 17:53:38,921 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 79dd09a662e99a3de62daf35d6a0df12: 2023-07-11 17:53:38,921 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1689098017322.79dd09a662e99a3de62daf35d6a0df12. 2023-07-11 17:53:38,921 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 17:53:38,921 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 17:53:38,921 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:38,921 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-07-11 17:53:38,921 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-07-11 17:53:38,924 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:38,924 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:38,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:38,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:53:38,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:53:38,924 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:38,924 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 17:53:38,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:53:38,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:53:38,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:38,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:38,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:53:38,926 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-07-11 17:53:38,926 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@60716563[Count = 0] remaining members to acquire global barrier 2023-07-11 17:53:38,926 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-07-11 17:53:38,926 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:38,927 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:38,927 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:38,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:38,928 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-07-11 17:53:38,928 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-07-11 17:53:38,928 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase9.apache.org,45839,1689097999112' in zk 2023-07-11 17:53:38,928 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:38,928 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 17:53:38,929 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:38,929 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-07-11 17:53:38,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:38,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:53:38,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:53:38,929 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:53:38,929 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-07-11 17:53:38,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:53:38,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:53:38,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:38,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:38,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:53:38,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:38,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:38,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase9.apache.org,45839,1689097999112': 2023-07-11 17:53:38,933 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-07-11 17:53:38,933 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-07-11 17:53:38,933 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 17:53:38,933 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 17:53:38,933 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:38,933 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 17:53:38,935 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:38,935 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:38,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:38,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:53:38,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:53:38,935 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:38,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:38,935 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:53:38,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:53:38,936 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:53:38,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:53:38,936 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:38,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:38,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:38,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:53:38,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:38,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:38,938 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:38,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:53:38,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:38,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:38,941 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:38,942 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:53:38,942 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:38,942 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:53:38,942 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-07-11 17:53:38,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:53:38,942 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 17:53:38,942 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:53:38,942 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:38,943 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:38,942 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:53:38,943 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:38,943 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-07-11 17:53:38,943 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:38,943 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:53:38,943 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:38,943 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 17:53:38,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:53:39,043 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 17:53:39,044 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 17:53:39,050 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 17:53:39,052 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-07-11 17:53:39,052 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:39,052 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-07-11 17:53:39,052 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:53:39,052 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-07-11 17:53:39,052 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-07-11 17:53:39,053 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:39,053 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:39,054 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:39,054 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:53:39,054 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:53:39,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:53:39,055 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:39,055 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 17:53:39,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:39,055 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:39,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 17:53:39,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:39,055 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:39,056 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-07-11 17:53:39,056 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:39,056 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-07-11 17:53:39,056 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:53:39,056 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-07-11 17:53:39,056 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 17:53:39,056 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 17:53:39,056 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1689098017322.79dd09a662e99a3de62daf35d6a0df12. 2023-07-11 17:53:39,056 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1689098017322.79dd09a662e99a3de62daf35d6a0df12. started... 2023-07-11 17:53:39,057 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 79dd09a662e99a3de62daf35d6a0df12 1/1 column families, dataSize=74 B heapSize=408 B 2023-07-11 17:53:39,472 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511282146e245cda64674bc7518cf4b35c26e to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511282146e245cda64674bc7518cf4b35c26e 2023-07-11 17:53:39,878 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithMonthlyPolicy/79dd09a662e99a3de62daf35d6a0df12/.tmp/family1/d03d0fcae8564c21b214b65fb19f0db6 2023-07-11 17:53:39,885 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithMonthlyPolicy/79dd09a662e99a3de62daf35d6a0df12/.tmp/family1/d03d0fcae8564c21b214b65fb19f0db6 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithMonthlyPolicy/79dd09a662e99a3de62daf35d6a0df12/family1/d03d0fcae8564c21b214b65fb19f0db6 2023-07-11 17:53:39,891 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithMonthlyPolicy/79dd09a662e99a3de62daf35d6a0df12/family1/d03d0fcae8564c21b214b65fb19f0db6, entries=1, sequenceid=9, filesize=5.0 K 2023-07-11 17:53:39,892 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 79dd09a662e99a3de62daf35d6a0df12 in 835ms, sequenceid=9, compaction requested=false 2023-07-11 17:53:39,892 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 79dd09a662e99a3de62daf35d6a0df12: 2023-07-11 17:53:39,892 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1689098017322.79dd09a662e99a3de62daf35d6a0df12. 2023-07-11 17:53:39,892 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 17:53:39,892 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 17:53:39,892 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:39,892 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-07-11 17:53:39,892 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-07-11 17:53:39,894 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:39,894 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:39,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:39,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:53:39,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:53:39,894 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:39,894 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 17:53:39,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:53:39,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:53:39,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:39,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:39,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:53:39,896 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-07-11 17:53:39,896 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@133d530e[Count = 0] remaining members to acquire global barrier 2023-07-11 17:53:39,896 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-07-11 17:53:39,896 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:39,897 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:39,897 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:39,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:39,897 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-07-11 17:53:39,897 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-07-11 17:53:39,897 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase9.apache.org,45839,1689097999112' in zk 2023-07-11 17:53:39,897 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:39,897 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 17:53:39,900 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-07-11 17:53:39,900 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:39,900 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:53:39,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:39,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:53:39,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:53:39,900 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-07-11 17:53:39,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:53:39,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:53:39,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:39,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:39,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:53:39,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:39,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:39,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase9.apache.org,45839,1689097999112': 2023-07-11 17:53:39,903 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-07-11 17:53:39,903 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-07-11 17:53:39,903 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 17:53:39,903 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 17:53:39,903 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:39,903 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 17:53:39,905 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:39,905 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:39,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:39,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:53:39,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:53:39,905 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:39,905 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:53:39,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:39,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:53:39,905 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:53:39,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:53:39,905 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:39,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:39,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:39,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:53:39,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:39,906 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:39,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:39,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:53:39,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:39,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:39,914 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:39,914 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:53:39,914 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:39,914 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-07-11 17:53:39,914 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:53:39,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:53:39,914 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-07-11 17:53:39,914 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 17:53:39,914 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:53:39,914 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:53:39,914 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:39,915 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:53:39,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:53:39,915 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:39,915 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:39,915 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-07-11 17:53:39,915 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 17:53:39,915 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:39,915 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:40,015 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 17:53:40,017 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 17:53:40,022 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 17:53:40,024 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-07-11 17:53:40,024 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:40,024 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-07-11 17:53:40,024 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:53:40,024 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-07-11 17:53:40,024 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-07-11 17:53:40,025 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:40,025 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:40,026 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:40,026 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:53:40,026 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:53:40,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:53:40,026 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:40,026 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 17:53:40,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:40,027 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:40,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 17:53:40,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:40,027 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:40,028 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-07-11 17:53:40,028 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:40,028 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-07-11 17:53:40,028 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:53:40,028 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-07-11 17:53:40,028 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 17:53:40,028 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 17:53:40,028 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1689098017322.79dd09a662e99a3de62daf35d6a0df12. 2023-07-11 17:53:40,029 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1689098017322.79dd09a662e99a3de62daf35d6a0df12. started... 2023-07-11 17:53:40,029 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 79dd09a662e99a3de62daf35d6a0df12 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-11 17:53:40,444 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512013b837c1c6eae4b8f83e6803003c79fa8 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512013b837c1c6eae4b8f83e6803003c79fa8 2023-07-11 17:53:40,850 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithMonthlyPolicy/79dd09a662e99a3de62daf35d6a0df12/.tmp/family1/bc7b51c5dc56481899f8f2a6f4f4e918 2023-07-11 17:53:40,856 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithMonthlyPolicy/79dd09a662e99a3de62daf35d6a0df12/.tmp/family1/bc7b51c5dc56481899f8f2a6f4f4e918 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithMonthlyPolicy/79dd09a662e99a3de62daf35d6a0df12/family1/bc7b51c5dc56481899f8f2a6f4f4e918 2023-07-11 17:53:40,861 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithMonthlyPolicy/79dd09a662e99a3de62daf35d6a0df12/family1/bc7b51c5dc56481899f8f2a6f4f4e918, entries=1, sequenceid=13, filesize=4.9 K 2023-07-11 17:53:40,862 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 79dd09a662e99a3de62daf35d6a0df12 in 833ms, sequenceid=13, compaction requested=true 2023-07-11 17:53:40,862 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 79dd09a662e99a3de62daf35d6a0df12: 2023-07-11 17:53:40,863 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1689098017322.79dd09a662e99a3de62daf35d6a0df12. 2023-07-11 17:53:40,863 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 17:53:40,863 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 17:53:40,863 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:40,863 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-07-11 17:53:40,863 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-07-11 17:53:40,864 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:40,864 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:40,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:40,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:53:40,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:53:40,865 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:40,865 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 17:53:40,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:53:40,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:53:40,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:40,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:40,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:53:40,866 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-07-11 17:53:40,867 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@59fa5f1a[Count = 0] remaining members to acquire global barrier 2023-07-11 17:53:40,867 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-07-11 17:53:40,867 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:40,869 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:40,869 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:40,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:40,869 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-07-11 17:53:40,869 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-07-11 17:53:40,869 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase9.apache.org,45839,1689097999112' in zk 2023-07-11 17:53:40,870 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:40,870 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 17:53:40,871 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:40,871 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-07-11 17:53:40,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:40,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:53:40,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:53:40,871 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:53:40,871 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-07-11 17:53:40,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:53:40,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:53:40,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:40,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:40,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:53:40,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:40,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:40,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase9.apache.org,45839,1689097999112': 2023-07-11 17:53:40,875 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-07-11 17:53:40,875 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-07-11 17:53:40,875 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 17:53:40,875 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 17:53:40,875 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:40,875 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 17:53:40,877 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:40,877 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:40,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:40,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:53:40,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:53:40,877 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:40,877 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:53:40,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:40,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:53:40,878 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:53:40,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:53:40,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:40,878 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:40,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:40,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:53:40,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:40,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:40,880 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:40,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:53:40,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:40,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:40,884 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:53:40,884 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:40,884 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:53:40,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:53:40,884 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:40,884 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:40,885 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:40,885 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:40,885 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:40,885 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:40,884 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:53:40,885 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:53:40,885 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-07-11 17:53:40,893 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 17:53:40,893 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:53:40,893 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-07-11 17:53:40,893 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 17:53:40,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:53:40,994 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 17:53:40,995 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 17:53:41,000 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 17:53:41,001 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-07-11 17:53:41,002 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:41,002 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-07-11 17:53:41,002 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:53:41,002 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-07-11 17:53:41,002 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-07-11 17:53:41,003 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:41,003 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:41,005 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:53:41,005 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:41,005 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:53:41,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:53:41,005 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:41,006 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 17:53:41,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:41,006 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:41,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 17:53:41,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:41,006 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:41,007 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-07-11 17:53:41,007 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:41,007 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-07-11 17:53:41,007 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:53:41,007 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-07-11 17:53:41,007 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 17:53:41,007 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 17:53:41,007 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1689098017322.79dd09a662e99a3de62daf35d6a0df12. 2023-07-11 17:53:41,007 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1689098017322.79dd09a662e99a3de62daf35d6a0df12. started... 2023-07-11 17:53:41,008 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 79dd09a662e99a3de62daf35d6a0df12 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-11 17:53:41,424 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120596a903c3bb9940b7a05872d9b92e5e09 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015120596a903c3bb9940b7a05872d9b92e5e09 2023-07-11 17:53:41,427 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-07-11 17:53:41,430 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithMonthlyPolicy/79dd09a662e99a3de62daf35d6a0df12/.tmp/family1/e9b91e8334894185a887c51bd0ba07ce 2023-07-11 17:53:41,437 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithMonthlyPolicy/79dd09a662e99a3de62daf35d6a0df12/.tmp/family1/e9b91e8334894185a887c51bd0ba07ce as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithMonthlyPolicy/79dd09a662e99a3de62daf35d6a0df12/family1/e9b91e8334894185a887c51bd0ba07ce 2023-07-11 17:53:41,443 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithMonthlyPolicy/79dd09a662e99a3de62daf35d6a0df12/family1/e9b91e8334894185a887c51bd0ba07ce, entries=1, sequenceid=17, filesize=4.9 K 2023-07-11 17:53:41,445 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 79dd09a662e99a3de62daf35d6a0df12 in 438ms, sequenceid=17, compaction requested=true 2023-07-11 17:53:41,445 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 79dd09a662e99a3de62daf35d6a0df12: 2023-07-11 17:53:41,445 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1689098017322.79dd09a662e99a3de62daf35d6a0df12. 2023-07-11 17:53:41,445 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 17:53:41,445 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 17:53:41,445 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:41,445 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-07-11 17:53:41,445 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-07-11 17:53:41,447 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:41,447 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:41,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:41,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:53:41,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:53:41,447 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:41,447 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 17:53:41,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:53:41,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:53:41,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:41,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:41,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:53:41,449 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-07-11 17:53:41,449 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1542d44[Count = 0] remaining members to acquire global barrier 2023-07-11 17:53:41,449 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-07-11 17:53:41,449 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:41,452 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:41,452 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:41,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:41,452 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-07-11 17:53:41,452 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-07-11 17:53:41,452 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase9.apache.org,45839,1689097999112' in zk 2023-07-11 17:53:41,452 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:41,452 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 17:53:41,456 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:41,456 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-07-11 17:53:41,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:41,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:53:41,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:53:41,456 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:53:41,456 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-07-11 17:53:41,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:53:41,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:53:41,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:41,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:41,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:53:41,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:41,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:41,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase9.apache.org,45839,1689097999112': 2023-07-11 17:53:41,459 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-07-11 17:53:41,459 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-07-11 17:53:41,459 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 17:53:41,459 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 17:53:41,459 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:41,459 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 17:53:41,462 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:41,462 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:53:41,462 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:41,462 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:41,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:41,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:41,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:53:41,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:53:41,463 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:41,463 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:53:41,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:53:41,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:53:41,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:41,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:41,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:53:41,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:41,464 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:41,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:41,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:53:41,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:41,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:41,467 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:41,467 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:41,467 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:41,467 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:41,467 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:53:41,467 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:41,467 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:53:41,467 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:41,467 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-07-11 17:53:41,467 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-07-11 17:53:41,468 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 17:53:41,467 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:53:41,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:53:41,467 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:53:41,467 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:41,468 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-07-11 17:53:41,468 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 17:53:41,468 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:53:41,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:53:41,568 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 17:53:41,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 17:53:41,574 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 17:53:41,576 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-07-11 17:53:41,576 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:41,576 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-07-11 17:53:41,576 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:53:41,577 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-07-11 17:53:41,577 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-07-11 17:53:41,577 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:41,577 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:41,578 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:41,578 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:53:41,578 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:53:41,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:53:41,579 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:41,579 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 17:53:41,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:41,579 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:41,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 17:53:41,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:41,579 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:41,580 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-07-11 17:53:41,580 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:41,580 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-07-11 17:53:41,580 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:53:41,580 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-07-11 17:53:41,580 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 17:53:41,581 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 17:53:41,581 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1689098017322.79dd09a662e99a3de62daf35d6a0df12. 2023-07-11 17:53:41,581 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1689098017322.79dd09a662e99a3de62daf35d6a0df12. started... 2023-07-11 17:53:41,581 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 79dd09a662e99a3de62daf35d6a0df12 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-11 17:53:41,996 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512288f6d546a013f493ab954552c9ccfe486 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512288f6d546a013f493ab954552c9ccfe486 2023-07-11 17:53:42,403 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithMonthlyPolicy/79dd09a662e99a3de62daf35d6a0df12/.tmp/family1/4280abce00b94726ab0934afc4f888c7 2023-07-11 17:53:42,409 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithMonthlyPolicy/79dd09a662e99a3de62daf35d6a0df12/.tmp/family1/4280abce00b94726ab0934afc4f888c7 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithMonthlyPolicy/79dd09a662e99a3de62daf35d6a0df12/family1/4280abce00b94726ab0934afc4f888c7 2023-07-11 17:53:42,415 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithMonthlyPolicy/79dd09a662e99a3de62daf35d6a0df12/family1/4280abce00b94726ab0934afc4f888c7, entries=1, sequenceid=21, filesize=4.9 K 2023-07-11 17:53:42,416 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 79dd09a662e99a3de62daf35d6a0df12 in 835ms, sequenceid=21, compaction requested=true 2023-07-11 17:53:42,416 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 79dd09a662e99a3de62daf35d6a0df12: 2023-07-11 17:53:42,416 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1689098017322.79dd09a662e99a3de62daf35d6a0df12. 2023-07-11 17:53:42,416 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 17:53:42,416 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 17:53:42,416 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:42,416 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-07-11 17:53:42,416 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-07-11 17:53:42,418 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:42,418 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:42,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:42,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:53:42,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:53:42,418 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:42,418 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 17:53:42,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:53:42,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:53:42,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:42,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:42,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:53:42,420 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-07-11 17:53:42,420 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6ae50a70[Count = 0] remaining members to acquire global barrier 2023-07-11 17:53:42,420 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-07-11 17:53:42,420 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:42,422 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:42,423 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:42,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:42,423 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-07-11 17:53:42,423 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-07-11 17:53:42,423 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase9.apache.org,45839,1689097999112' in zk 2023-07-11 17:53:42,423 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:42,423 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 17:53:42,425 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:42,425 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-07-11 17:53:42,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:42,425 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:53:42,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:53:42,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:53:42,425 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-07-11 17:53:42,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:53:42,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:53:42,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:42,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:42,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:53:42,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:42,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:42,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase9.apache.org,45839,1689097999112': 2023-07-11 17:53:42,429 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-07-11 17:53:42,429 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-07-11 17:53:42,429 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 17:53:42,429 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 17:53:42,429 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:42,429 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 17:53:42,437 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:42,437 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:42,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:42,437 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:42,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:53:42,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:53:42,437 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:53:42,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:42,437 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:42,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:53:42,437 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:53:42,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:53:42,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:42,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:42,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:53:42,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:42,438 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:42,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:42,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:53:42,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:42,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:42,440 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:42,440 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:53:42,440 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:42,441 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:53:42,441 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:53:42,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:53:42,441 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-07-11 17:53:42,441 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 17:53:42,441 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:42,441 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:53:42,442 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-07-11 17:53:42,442 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:53:42,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:53:42,441 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:42,442 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:42,442 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:42,442 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-07-11 17:53:42,442 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:42,442 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 17:53:42,542 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 17:53:42,543 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 17:53:42,548 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 17:53:42,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-07-11 17:53:42,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:42,550 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-07-11 17:53:42,550 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:53:42,551 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-07-11 17:53:42,551 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-07-11 17:53:42,551 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:42,551 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:42,553 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:42,553 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:53:42,553 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:53:42,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:53:42,553 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:42,553 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 17:53:42,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:42,553 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:42,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 17:53:42,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:42,554 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:42,554 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-07-11 17:53:42,554 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:42,554 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-07-11 17:53:42,554 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:53:42,555 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-07-11 17:53:42,555 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 17:53:42,555 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 17:53:42,555 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1689098017322.79dd09a662e99a3de62daf35d6a0df12. 2023-07-11 17:53:42,555 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1689098017322.79dd09a662e99a3de62daf35d6a0df12. started... 2023-07-11 17:53:42,555 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 79dd09a662e99a3de62daf35d6a0df12 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-11 17:53:42,970 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015123173d9069b9ad14d3c8e2a55fd173b9df0 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015123173d9069b9ad14d3c8e2a55fd173b9df0 2023-07-11 17:53:43,377 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithMonthlyPolicy/79dd09a662e99a3de62daf35d6a0df12/.tmp/family1/91248b4f1cc5423e815c3a133fb4934c 2023-07-11 17:53:43,383 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithMonthlyPolicy/79dd09a662e99a3de62daf35d6a0df12/.tmp/family1/91248b4f1cc5423e815c3a133fb4934c as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithMonthlyPolicy/79dd09a662e99a3de62daf35d6a0df12/family1/91248b4f1cc5423e815c3a133fb4934c 2023-07-11 17:53:43,387 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithMonthlyPolicy/79dd09a662e99a3de62daf35d6a0df12/family1/91248b4f1cc5423e815c3a133fb4934c, entries=1, sequenceid=25, filesize=4.9 K 2023-07-11 17:53:43,388 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 79dd09a662e99a3de62daf35d6a0df12 in 833ms, sequenceid=25, compaction requested=true 2023-07-11 17:53:43,388 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 79dd09a662e99a3de62daf35d6a0df12: 2023-07-11 17:53:43,388 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1689098017322.79dd09a662e99a3de62daf35d6a0df12. 2023-07-11 17:53:43,388 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 17:53:43,388 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 17:53:43,388 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:43,388 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-07-11 17:53:43,389 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-07-11 17:53:43,390 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:43,390 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:43,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:43,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:53:43,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:53:43,390 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:43,390 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 17:53:43,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:53:43,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:53:43,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:43,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:43,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:53:43,392 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-07-11 17:53:43,392 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@13b99101[Count = 0] remaining members to acquire global barrier 2023-07-11 17:53:43,392 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-07-11 17:53:43,392 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:43,394 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:43,394 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:43,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:43,394 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-07-11 17:53:43,394 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:43,394 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 17:53:43,394 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-07-11 17:53:43,394 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase9.apache.org,45839,1689097999112' in zk 2023-07-11 17:53:43,395 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-07-11 17:53:43,395 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:53:43,395 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:43,395 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-07-11 17:53:43,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:43,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:53:43,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:53:43,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:53:43,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:53:43,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:43,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:43,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:53:43,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:43,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:43,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase9.apache.org,45839,1689097999112': 2023-07-11 17:53:43,398 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-07-11 17:53:43,398 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-07-11 17:53:43,398 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 17:53:43,398 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 17:53:43,398 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:43,398 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 17:53:43,400 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:43,400 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:53:43,400 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:43,400 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:43,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:43,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:43,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:53:43,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:53:43,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:53:43,400 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:43,401 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:53:43,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:53:43,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:43,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:43,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:53:43,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:43,402 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:43,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:43,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:53:43,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:43,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:43,404 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:43,404 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:43,404 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:53:43,404 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:43,404 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:53:43,404 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:53:43,404 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:53:43,404 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-07-11 17:53:43,405 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 17:53:43,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:53:43,404 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:43,405 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-07-11 17:53:43,405 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:43,405 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:43,405 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:43,405 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-07-11 17:53:43,406 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 17:53:43,406 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:53:43,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:53:43,506 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 17:53:43,507 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 17:53:43,512 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 17:53:43,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-07-11 17:53:43,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:43,514 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-07-11 17:53:43,514 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:53:43,514 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-07-11 17:53:43,514 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-07-11 17:53:43,515 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:43,515 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:43,517 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:43,517 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:53:43,517 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:53:43,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:53:43,518 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:43,518 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 17:53:43,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:43,518 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:43,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 17:53:43,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:43,518 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:43,519 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-07-11 17:53:43,519 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:43,519 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-07-11 17:53:43,519 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:53:43,519 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-07-11 17:53:43,519 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 17:53:43,519 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 17:53:43,520 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1689098017322.79dd09a662e99a3de62daf35d6a0df12. 2023-07-11 17:53:43,520 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1689098017322.79dd09a662e99a3de62daf35d6a0df12. started... 2023-07-11 17:53:43,520 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 79dd09a662e99a3de62daf35d6a0df12 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-11 17:53:43,937 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010172a88d7a4d9f4678b12d18a973a9c6e9 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2016010172a88d7a4d9f4678b12d18a973a9c6e9 2023-07-11 17:53:44,344 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithMonthlyPolicy/79dd09a662e99a3de62daf35d6a0df12/.tmp/family1/464d4e4ef75e499c8adace9f92a03059 2023-07-11 17:53:44,350 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithMonthlyPolicy/79dd09a662e99a3de62daf35d6a0df12/.tmp/family1/464d4e4ef75e499c8adace9f92a03059 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithMonthlyPolicy/79dd09a662e99a3de62daf35d6a0df12/family1/464d4e4ef75e499c8adace9f92a03059 2023-07-11 17:53:44,356 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithMonthlyPolicy/79dd09a662e99a3de62daf35d6a0df12/family1/464d4e4ef75e499c8adace9f92a03059, entries=1, sequenceid=29, filesize=4.9 K 2023-07-11 17:53:44,357 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 79dd09a662e99a3de62daf35d6a0df12 in 837ms, sequenceid=29, compaction requested=true 2023-07-11 17:53:44,357 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 79dd09a662e99a3de62daf35d6a0df12: 2023-07-11 17:53:44,357 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1689098017322.79dd09a662e99a3de62daf35d6a0df12. 2023-07-11 17:53:44,357 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 17:53:44,358 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 17:53:44,358 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:44,358 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-07-11 17:53:44,358 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-07-11 17:53:44,359 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:44,359 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:44,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:44,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:53:44,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:53:44,360 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:44,360 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 17:53:44,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:53:44,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:53:44,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:44,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:44,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:53:44,361 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-07-11 17:53:44,362 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@18b01ee3[Count = 0] remaining members to acquire global barrier 2023-07-11 17:53:44,362 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-07-11 17:53:44,362 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:44,363 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:44,363 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:44,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:44,363 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-07-11 17:53:44,363 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-07-11 17:53:44,363 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase9.apache.org,45839,1689097999112' in zk 2023-07-11 17:53:44,363 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:44,363 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 17:53:44,365 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-07-11 17:53:44,365 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:44,365 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:53:44,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:44,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:53:44,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:53:44,365 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-07-11 17:53:44,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:53:44,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:53:44,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:44,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:44,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:53:44,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:44,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:44,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase9.apache.org,45839,1689097999112': 2023-07-11 17:53:44,368 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-07-11 17:53:44,368 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-07-11 17:53:44,369 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 17:53:44,369 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 17:53:44,369 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:44,369 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 17:53:44,372 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:44,372 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:44,372 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:44,372 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:53:44,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:44,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:44,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:53:44,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:53:44,372 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:53:44,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:53:44,372 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:44,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:53:44,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:44,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:44,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:53:44,374 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:44,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:44,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:44,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:53:44,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:44,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:44,377 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:44,377 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:44,377 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:44,377 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:44,377 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:44,377 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:53:44,377 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:53:44,377 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-07-11 17:53:44,377 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 17:53:44,377 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:44,377 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:53:44,377 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:53:44,378 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-07-11 17:53:44,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:53:44,378 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:44,378 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-07-11 17:53:44,378 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 17:53:44,378 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:53:44,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:53:44,478 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 17:53:44,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 17:53:44,486 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 17:53:44,488 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-07-11 17:53:44,488 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:44,488 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-07-11 17:53:44,488 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:53:44,488 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-07-11 17:53:44,489 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-07-11 17:53:44,489 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:44,489 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:44,490 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:53:44,490 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:44,491 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:53:44,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:53:44,491 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:44,491 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 17:53:44,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:44,491 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:44,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 17:53:44,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:44,492 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:44,492 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-07-11 17:53:44,492 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:44,492 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-07-11 17:53:44,492 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:53:44,492 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-07-11 17:53:44,493 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 17:53:44,493 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 17:53:44,493 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1689098017322.79dd09a662e99a3de62daf35d6a0df12. 2023-07-11 17:53:44,493 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1689098017322.79dd09a662e99a3de62daf35d6a0df12. started... 2023-07-11 17:53:44,493 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 79dd09a662e99a3de62daf35d6a0df12 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-11 17:53:44,908 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010352f2fce11d5f4e2e8f2a7d01bf26ceaa to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2016010352f2fce11d5f4e2e8f2a7d01bf26ceaa 2023-07-11 17:53:45,314 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithMonthlyPolicy/79dd09a662e99a3de62daf35d6a0df12/.tmp/family1/e00becb179d849fbb088cfb73286310b 2023-07-11 17:53:45,320 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithMonthlyPolicy/79dd09a662e99a3de62daf35d6a0df12/.tmp/family1/e00becb179d849fbb088cfb73286310b as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithMonthlyPolicy/79dd09a662e99a3de62daf35d6a0df12/family1/e00becb179d849fbb088cfb73286310b 2023-07-11 17:53:45,326 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithMonthlyPolicy/79dd09a662e99a3de62daf35d6a0df12/family1/e00becb179d849fbb088cfb73286310b, entries=1, sequenceid=33, filesize=4.9 K 2023-07-11 17:53:45,327 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 79dd09a662e99a3de62daf35d6a0df12 in 834ms, sequenceid=33, compaction requested=true 2023-07-11 17:53:45,327 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 79dd09a662e99a3de62daf35d6a0df12: 2023-07-11 17:53:45,327 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1689098017322.79dd09a662e99a3de62daf35d6a0df12. 2023-07-11 17:53:45,327 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 17:53:45,327 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 17:53:45,327 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:45,327 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-07-11 17:53:45,327 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-07-11 17:53:45,329 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:45,329 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:45,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:45,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:53:45,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:53:45,329 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:45,329 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 17:53:45,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:53:45,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:53:45,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:45,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:45,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:53:45,331 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-07-11 17:53:45,331 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@382e2ebc[Count = 0] remaining members to acquire global barrier 2023-07-11 17:53:45,331 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-07-11 17:53:45,331 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:45,333 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:45,334 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:45,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:45,334 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-07-11 17:53:45,334 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-07-11 17:53:45,334 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase9.apache.org,45839,1689097999112' in zk 2023-07-11 17:53:45,334 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:45,334 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 17:53:45,338 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-07-11 17:53:45,338 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:45,338 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:53:45,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:45,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:53:45,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:53:45,338 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-07-11 17:53:45,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:53:45,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:53:45,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:45,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:45,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:53:45,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:45,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:45,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase9.apache.org,45839,1689097999112': 2023-07-11 17:53:45,341 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-07-11 17:53:45,341 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-07-11 17:53:45,341 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 17:53:45,341 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 17:53:45,341 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:45,341 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 17:53:45,342 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:45,343 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:45,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:45,343 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:45,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:53:45,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:53:45,343 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:53:45,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:45,343 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:45,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:53:45,343 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:53:45,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:53:45,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:45,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:45,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:53:45,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:45,344 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:45,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:45,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:53:45,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:45,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:45,347 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:45,347 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:53:45,347 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:45,347 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:53:45,347 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-07-11 17:53:45,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:53:45,347 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:53:45,347 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 17:53:45,347 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:53:45,347 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:45,347 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-07-11 17:53:45,347 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:45,348 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:45,348 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:45,348 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:45,348 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-07-11 17:53:45,348 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 17:53:45,348 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:53:45,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:53:45,448 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 17:53:45,449 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 17:53:45,454 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 17:53:45,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-07-11 17:53:45,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:45,457 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-07-11 17:53:45,457 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:53:45,457 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-07-11 17:53:45,458 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-07-11 17:53:45,458 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:45,458 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:45,459 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:45,459 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:53:45,459 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:53:45,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:53:45,459 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:45,459 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 17:53:45,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:45,460 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:45,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 17:53:45,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:45,460 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:45,460 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-07-11 17:53:45,460 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:45,460 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-07-11 17:53:45,460 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:53:45,461 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-07-11 17:53:45,461 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 17:53:45,461 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 17:53:45,461 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1689098017322.79dd09a662e99a3de62daf35d6a0df12. 2023-07-11 17:53:45,461 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1689098017322.79dd09a662e99a3de62daf35d6a0df12. started... 2023-07-11 17:53:45,461 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 79dd09a662e99a3de62daf35d6a0df12 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-11 17:53:45,877 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509071e50ff827e8e4c07b41a41adc4d7ed4e to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201509071e50ff827e8e4c07b41a41adc4d7ed4e 2023-07-11 17:53:46,283 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithMonthlyPolicy/79dd09a662e99a3de62daf35d6a0df12/.tmp/family1/b38c880baa694e8f9ec0ed200ef1cb75 2023-07-11 17:53:46,289 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithMonthlyPolicy/79dd09a662e99a3de62daf35d6a0df12/.tmp/family1/b38c880baa694e8f9ec0ed200ef1cb75 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithMonthlyPolicy/79dd09a662e99a3de62daf35d6a0df12/family1/b38c880baa694e8f9ec0ed200ef1cb75 2023-07-11 17:53:46,294 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithMonthlyPolicy/79dd09a662e99a3de62daf35d6a0df12/family1/b38c880baa694e8f9ec0ed200ef1cb75, entries=1, sequenceid=37, filesize=4.9 K 2023-07-11 17:53:46,296 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 79dd09a662e99a3de62daf35d6a0df12 in 835ms, sequenceid=37, compaction requested=true 2023-07-11 17:53:46,296 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 79dd09a662e99a3de62daf35d6a0df12: 2023-07-11 17:53:46,296 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1689098017322.79dd09a662e99a3de62daf35d6a0df12. 2023-07-11 17:53:46,296 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 17:53:46,296 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 17:53:46,296 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:46,296 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-07-11 17:53:46,296 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-07-11 17:53:46,297 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:46,297 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:46,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:46,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:53:46,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:53:46,298 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:46,298 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 17:53:46,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:53:46,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:53:46,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:46,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:46,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:53:46,299 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-07-11 17:53:46,299 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7a5a0543[Count = 0] remaining members to acquire global barrier 2023-07-11 17:53:46,299 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-07-11 17:53:46,300 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:46,301 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:46,301 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:46,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:46,301 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-07-11 17:53:46,301 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-07-11 17:53:46,301 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase9.apache.org,45839,1689097999112' in zk 2023-07-11 17:53:46,301 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:46,301 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 17:53:46,303 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:46,303 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-07-11 17:53:46,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:46,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:53:46,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:53:46,303 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:53:46,303 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-07-11 17:53:46,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:53:46,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:53:46,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:46,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:46,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:53:46,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:46,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:46,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase9.apache.org,45839,1689097999112': 2023-07-11 17:53:46,306 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-07-11 17:53:46,306 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-07-11 17:53:46,306 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 17:53:46,306 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 17:53:46,306 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:46,306 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 17:53:46,308 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:46,308 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:46,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:46,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:53:46,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:53:46,308 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:46,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:46,308 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:53:46,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:53:46,309 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:53:46,309 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:46,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:53:46,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:46,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:46,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:53:46,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:46,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:46,310 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:46,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:53:46,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:46,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:46,312 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:46,312 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:53:46,312 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:46,312 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:53:46,312 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:46,312 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:53:46,312 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:53:46,312 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-07-11 17:53:46,313 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 17:53:46,312 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:46,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:53:46,313 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:46,313 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:46,313 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:46,313 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-07-11 17:53:46,313 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:53:46,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:53:46,313 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 17:53:46,414 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 17:53:46,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 17:53:46,421 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 17:53:46,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-07-11 17:53:46,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:46,427 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-07-11 17:53:46,427 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:53:46,428 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-07-11 17:53:46,428 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-07-11 17:53:46,428 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:46,429 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:46,430 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:46,430 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:53:46,430 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:53:46,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:53:46,430 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:46,430 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 17:53:46,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:46,431 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:46,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 17:53:46,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:46,431 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:46,431 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-07-11 17:53:46,431 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:46,431 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-07-11 17:53:46,432 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:53:46,433 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-07-11 17:53:46,433 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 17:53:46,433 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 17:53:46,433 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1689098017322.79dd09a662e99a3de62daf35d6a0df12. 2023-07-11 17:53:46,433 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1689098017322.79dd09a662e99a3de62daf35d6a0df12. started... 2023-07-11 17:53:46,434 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 79dd09a662e99a3de62daf35d6a0df12 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-11 17:53:46,852 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120ce612cb6b2cc4945a3eb7d2116df2df3 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151120ce612cb6b2cc4945a3eb7d2116df2df3 2023-07-11 17:53:47,258 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithMonthlyPolicy/79dd09a662e99a3de62daf35d6a0df12/.tmp/family1/020c1fe1c3fa452095b5aecbac1b90d1 2023-07-11 17:53:47,264 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithMonthlyPolicy/79dd09a662e99a3de62daf35d6a0df12/.tmp/family1/020c1fe1c3fa452095b5aecbac1b90d1 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithMonthlyPolicy/79dd09a662e99a3de62daf35d6a0df12/family1/020c1fe1c3fa452095b5aecbac1b90d1 2023-07-11 17:53:47,269 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithMonthlyPolicy/79dd09a662e99a3de62daf35d6a0df12/family1/020c1fe1c3fa452095b5aecbac1b90d1, entries=1, sequenceid=41, filesize=4.9 K 2023-07-11 17:53:47,270 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 79dd09a662e99a3de62daf35d6a0df12 in 836ms, sequenceid=41, compaction requested=true 2023-07-11 17:53:47,270 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 79dd09a662e99a3de62daf35d6a0df12: 2023-07-11 17:53:47,270 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1689098017322.79dd09a662e99a3de62daf35d6a0df12. 2023-07-11 17:53:47,270 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 17:53:47,270 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 17:53:47,270 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:47,270 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-07-11 17:53:47,270 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-07-11 17:53:47,272 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:47,272 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:47,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:47,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:53:47,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:53:47,272 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:47,272 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 17:53:47,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:53:47,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:53:47,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:47,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:47,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:53:47,273 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-07-11 17:53:47,274 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@25b4a290[Count = 0] remaining members to acquire global barrier 2023-07-11 17:53:47,274 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-07-11 17:53:47,274 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:47,274 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:47,275 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:47,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:47,275 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-07-11 17:53:47,275 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-07-11 17:53:47,275 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase9.apache.org,45839,1689097999112' in zk 2023-07-11 17:53:47,275 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:47,275 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 17:53:47,276 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:47,276 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-07-11 17:53:47,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:47,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:53:47,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:53:47,276 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:53:47,276 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-07-11 17:53:47,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:53:47,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:53:47,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:47,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:47,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:53:47,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:47,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:47,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase9.apache.org,45839,1689097999112': 2023-07-11 17:53:47,279 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-07-11 17:53:47,279 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-07-11 17:53:47,279 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 17:53:47,279 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 17:53:47,279 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:47,279 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 17:53:47,282 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:47,282 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:47,282 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:47,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:47,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:53:47,282 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:53:47,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:53:47,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:47,282 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:47,282 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:53:47,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:53:47,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:53:47,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:47,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:47,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:53:47,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:47,283 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:47,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:47,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:53:47,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:47,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:47,286 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:47,286 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:47,286 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:53:47,286 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:47,286 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-07-11 17:53:47,286 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:47,286 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:53:47,286 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-07-11 17:53:47,286 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 17:53:47,286 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:53:47,286 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:53:47,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:53:47,286 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:47,286 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:47,286 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-07-11 17:53:47,288 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 17:53:47,286 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:47,288 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:53:47,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:53:47,388 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 17:53:47,389 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 17:53:47,390 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=36885] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithMonthlyPolicy 2023-07-11 17:53:47,392 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] procedure2.ProcedureExecutor(1029): Stored pid=22, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-07-11 17:53:47,393 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=22, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-07-11 17:53:47,394 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithMonthlyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-07-11 17:53:47,394 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=22, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1689098627394 2023-07-11 17:53:47,395 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-07-11 17:53:47,396 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithMonthlyPolicy' and column 'family1' 2023-07-11 17:53:47,396 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-07-11 17:53:47,397 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] zookeeper.ReadOnlyZKClient(139): Connect 0x243d5bfb to 127.0.0.1:50702 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 17:53:47,402 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@56def80, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 17:53:47,402 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-07-11 17:53:48,244 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601034685a8f38fd74d329d25f7b8970276a0 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201601034685a8f38fd74d329d25f7b8970276a0 2023-07-11 17:53:48,245 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-07-11 17:53:48,258 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 17:53:48,259 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:43186, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 17:53:48,266 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-11 17:53:48,267 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:53574, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-11 17:53:48,277 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/a4a7a25685c44c35ba2c386840ac3abe first=Optional[r5] last=Optional[r6] 2023-07-11 17:53:48,278 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1689098017322.79dd09a662e99a3de62daf35d6a0df12., hostname=jenkins-hbase9.apache.org,45839,1689097999112, seqNum=2 for row with hfile group [{family1,hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/a4a7a25685c44c35ba2c386840ac3abe}] 2023-07-11 17:53:48,282 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(763): Validating hfile at hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/a4a7a25685c44c35ba2c386840ac3abe for inclusion in 79dd09a662e99a3de62daf35d6a0df12/family1 2023-07-11 17:53:48,284 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(775): HFile bounds: first=r5 last=r6 2023-07-11 17:53:48,284 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(777): Region bounds: first= last= 2023-07-11 17:53:48,285 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HRegion(2446): Flush status journal for 79dd09a662e99a3de62daf35d6a0df12: 2023-07-11 17:53:48,286 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/a4a7a25685c44c35ba2c386840ac3abe to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testMajorCompactionWithMonthlyPolicy__jnlnlhmt2nl3p0svro31p98jpa8qftam3boojljr283gheceumsh0ib1blgfrp6h/family1/a4a7a25685c44c35ba2c386840ac3abe 2023-07-11 17:53:48,289 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testMajorCompactionWithMonthlyPolicy__jnlnlhmt2nl3p0svro31p98jpa8qftam3boojljr283gheceumsh0ib1blgfrp6h/family1/a4a7a25685c44c35ba2c386840ac3abe as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithMonthlyPolicy/79dd09a662e99a3de62daf35d6a0df12/family1/74ea44f2b1084a00a585f7672d042a5f_SeqId_44_ 2023-07-11 17:53:48,289 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(849): Loaded HFile hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testMajorCompactionWithMonthlyPolicy__jnlnlhmt2nl3p0svro31p98jpa8qftam3boojljr283gheceumsh0ib1blgfrp6h/family1/a4a7a25685c44c35ba2c386840ac3abe into 79dd09a662e99a3de62daf35d6a0df12/family1 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithMonthlyPolicy/79dd09a662e99a3de62daf35d6a0df12/family1/74ea44f2b1084a00a585f7672d042a5f_SeqId_44_ - updating store file list. 2023-07-11 17:53:48,294 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(882): Loaded HFile hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithMonthlyPolicy/79dd09a662e99a3de62daf35d6a0df12/family1/74ea44f2b1084a00a585f7672d042a5f_SeqId_44_ into 79dd09a662e99a3de62daf35d6a0df12/family1 2023-07-11 17:53:48,294 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(855): Successfully loaded hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testMajorCompactionWithMonthlyPolicy__jnlnlhmt2nl3p0svro31p98jpa8qftam3boojljr283gheceumsh0ib1blgfrp6h/family1/a4a7a25685c44c35ba2c386840ac3abe into 79dd09a662e99a3de62daf35d6a0df12/family1 (new location: hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithMonthlyPolicy/79dd09a662e99a3de62daf35d6a0df12/family1/74ea44f2b1084a00a585f7672d042a5f_SeqId_44_) 2023-07-11 17:53:48,295 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testMajorCompactionWithMonthlyPolicy__jnlnlhmt2nl3p0svro31p98jpa8qftam3boojljr283gheceumsh0ib1blgfrp6h/family1/a4a7a25685c44c35ba2c386840ac3abe 2023-07-11 17:53:48,295 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-07-11 17:53:48,298 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 50903 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-07-11 17:53:48,298 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(1912): 79dd09a662e99a3de62daf35d6a0df12/family1 is initiating minor compaction 2023-07-11 17:53:48,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@5c32d7ab; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-11 17:53:48,299 INFO [RS:0;jenkins-hbase9:45839-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 79dd09a662e99a3de62daf35d6a0df12/family1 in testMajorCompactionWithMonthlyPolicy,,1689098017322.79dd09a662e99a3de62daf35d6a0df12. 2023-07-11 17:53:48,299 INFO [RS:0;jenkins-hbase9:45839-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithMonthlyPolicy/79dd09a662e99a3de62daf35d6a0df12/family1/d03d0fcae8564c21b214b65fb19f0db6, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithMonthlyPolicy/79dd09a662e99a3de62daf35d6a0df12/family1/bc7b51c5dc56481899f8f2a6f4f4e918, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithMonthlyPolicy/79dd09a662e99a3de62daf35d6a0df12/family1/e9b91e8334894185a887c51bd0ba07ce, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithMonthlyPolicy/79dd09a662e99a3de62daf35d6a0df12/family1/4280abce00b94726ab0934afc4f888c7, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithMonthlyPolicy/79dd09a662e99a3de62daf35d6a0df12/family1/91248b4f1cc5423e815c3a133fb4934c, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithMonthlyPolicy/79dd09a662e99a3de62daf35d6a0df12/family1/464d4e4ef75e499c8adace9f92a03059, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithMonthlyPolicy/79dd09a662e99a3de62daf35d6a0df12/family1/e00becb179d849fbb088cfb73286310b, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithMonthlyPolicy/79dd09a662e99a3de62daf35d6a0df12/family1/b38c880baa694e8f9ec0ed200ef1cb75, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithMonthlyPolicy/79dd09a662e99a3de62daf35d6a0df12/family1/020c1fe1c3fa452095b5aecbac1b90d1, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithMonthlyPolicy/79dd09a662e99a3de62daf35d6a0df12/family1/74ea44f2b1084a00a585f7672d042a5f_SeqId_44_] into tmpdir=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithMonthlyPolicy/79dd09a662e99a3de62daf35d6a0df12/.tmp, totalSize=49.7 K 2023-07-11 17:53:48,299 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] compactions.Compactor(207): Compacting d03d0fcae8564c21b214b65fb19f0db6, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-07-11 17:53:48,299 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] compactions.Compactor(207): Compacting bc7b51c5dc56481899f8f2a6f4f4e918, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-07-11 17:53:48,299 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] compactions.Compactor(207): Compacting e9b91e8334894185a887c51bd0ba07ce, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-07-11 17:53:48,299 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] compactions.Compactor(207): Compacting 4280abce00b94726ab0934afc4f888c7, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-07-11 17:53:48,299 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] compactions.Compactor(207): Compacting 91248b4f1cc5423e815c3a133fb4934c, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-07-11 17:53:48,299 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] compactions.Compactor(207): Compacting 464d4e4ef75e499c8adace9f92a03059, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-07-11 17:53:48,300 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] compactions.Compactor(207): Compacting e00becb179d849fbb088cfb73286310b, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-07-11 17:53:48,300 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] compactions.Compactor(207): Compacting b38c880baa694e8f9ec0ed200ef1cb75, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-07-11 17:53:48,300 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] compactions.Compactor(207): Compacting 020c1fe1c3fa452095b5aecbac1b90d1, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-07-11 17:53:48,300 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] compactions.Compactor(207): Compacting 74ea44f2b1084a00a585f7672d042a5f_SeqId_44_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=45 2023-07-11 17:53:48,301 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-07-11 17:53:48,302 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 17:53:48,304 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2016010172a88d7a4d9f4678b12d18a973a9c6e9 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2016010172a88d7a4d9f4678b12d18a973a9c6e9 2023-07-11 17:53:48,305 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2016010352f2fce11d5f4e2e8f2a7d01bf26ceaa to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2016010352f2fce11d5f4e2e8f2a7d01bf26ceaa 2023-07-11 17:53:48,305 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 2 expired mob files are deleted 2023-07-11 17:53:48,305 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101' 2023-07-11 17:53:48,306 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-07-11 17:53:48,306 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-07-11 17:53:48,342 INFO [RS:0;jenkins-hbase9:45839-shortCompactions-0] throttle.PressureAwareThroughputController(145): 79dd09a662e99a3de62daf35d6a0df12#family1#compaction#22 average throughput is 0.46 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-11 17:53:48,763 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512311bed5f9f340d4acf87c9c0e9a361fac0 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512311bed5f9f340d4acf87c9c0e9a361fac0 2023-07-11 17:53:48,764 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-07-11 17:53:48,791 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/381477aa61bc4184a5529b736c295494 first=Optional[r1] last=Optional[r4] 2023-07-11 17:53:48,792 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1689098017322.79dd09a662e99a3de62daf35d6a0df12., hostname=jenkins-hbase9.apache.org,45839,1689097999112, seqNum=2 for row with hfile group [{family1,hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/381477aa61bc4184a5529b736c295494}] 2023-07-11 17:53:48,794 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(763): Validating hfile at hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/381477aa61bc4184a5529b736c295494 for inclusion in 79dd09a662e99a3de62daf35d6a0df12/family1 2023-07-11 17:53:48,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(775): HFile bounds: first=r1 last=r4 2023-07-11 17:53:48,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(777): Region bounds: first= last= 2023-07-11 17:53:48,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HRegion(2446): Flush status journal for 79dd09a662e99a3de62daf35d6a0df12: 2023-07-11 17:53:48,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/381477aa61bc4184a5529b736c295494 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testMajorCompactionWithMonthlyPolicy__pqb0ul2s83u7rve15kqmhutrrijvjd0jjvl5ie1t5gplupv75kp0d1jl0f8cnh0k/family1/381477aa61bc4184a5529b736c295494 2023-07-11 17:53:48,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testMajorCompactionWithMonthlyPolicy__pqb0ul2s83u7rve15kqmhutrrijvjd0jjvl5ie1t5gplupv75kp0d1jl0f8cnh0k/family1/381477aa61bc4184a5529b736c295494 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithMonthlyPolicy/79dd09a662e99a3de62daf35d6a0df12/family1/f5da5b3f2d34457da5243617d05623f3_SeqId_46_ 2023-07-11 17:53:48,801 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(849): Loaded HFile hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testMajorCompactionWithMonthlyPolicy__pqb0ul2s83u7rve15kqmhutrrijvjd0jjvl5ie1t5gplupv75kp0d1jl0f8cnh0k/family1/381477aa61bc4184a5529b736c295494 into 79dd09a662e99a3de62daf35d6a0df12/family1 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithMonthlyPolicy/79dd09a662e99a3de62daf35d6a0df12/family1/f5da5b3f2d34457da5243617d05623f3_SeqId_46_ - updating store file list. 2023-07-11 17:53:48,806 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(882): Loaded HFile hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithMonthlyPolicy/79dd09a662e99a3de62daf35d6a0df12/family1/f5da5b3f2d34457da5243617d05623f3_SeqId_46_ into 79dd09a662e99a3de62daf35d6a0df12/family1 2023-07-11 17:53:48,806 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(855): Successfully loaded hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testMajorCompactionWithMonthlyPolicy__pqb0ul2s83u7rve15kqmhutrrijvjd0jjvl5ie1t5gplupv75kp0d1jl0f8cnh0k/family1/381477aa61bc4184a5529b736c295494 into 79dd09a662e99a3de62daf35d6a0df12/family1 (new location: hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithMonthlyPolicy/79dd09a662e99a3de62daf35d6a0df12/family1/f5da5b3f2d34457da5243617d05623f3_SeqId_46_) 2023-07-11 17:53:48,806 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testMajorCompactionWithMonthlyPolicy__pqb0ul2s83u7rve15kqmhutrrijvjd0jjvl5ie1t5gplupv75kp0d1jl0f8cnh0k/family1/381477aa61bc4184a5529b736c295494 2023-07-11 17:53:48,809 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-07-11 17:53:48,809 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 17:53:48,811 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512013b837c1c6eae4b8f83e6803003c79fa8 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512013b837c1c6eae4b8f83e6803003c79fa8 2023-07-11 17:53:48,812 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015120596a903c3bb9940b7a05872d9b92e5e09 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015120596a903c3bb9940b7a05872d9b92e5e09 2023-07-11 17:53:48,813 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512288f6d546a013f493ab954552c9ccfe486 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512288f6d546a013f493ab954552c9ccfe486 2023-07-11 17:53:48,815 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015123173d9069b9ad14d3c8e2a55fd173b9df0 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015123173d9069b9ad14d3c8e2a55fd173b9df0 2023-07-11 17:53:48,815 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 4 expired mob files are deleted 2023-07-11 17:53:48,815 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201' 2023-07-11 17:53:48,815 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-07-11 17:53:48,815 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-07-11 17:53:49,162 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithMonthlyPolicy/79dd09a662e99a3de62daf35d6a0df12/.tmp/family1/fb0a1e2990f243fc8fd170d3e67a99bd as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithMonthlyPolicy/79dd09a662e99a3de62daf35d6a0df12/family1/fb0a1e2990f243fc8fd170d3e67a99bd 2023-07-11 17:53:49,168 INFO [RS:0;jenkins-hbase9:45839-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 79dd09a662e99a3de62daf35d6a0df12/family1 of 79dd09a662e99a3de62daf35d6a0df12 into fb0a1e2990f243fc8fd170d3e67a99bd(size=6.6 K), total size for store is 178.1 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-11 17:53:49,168 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 79dd09a662e99a3de62daf35d6a0df12: 2023-07-11 17:53:49,169 INFO [RS:0;jenkins-hbase9:45839-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithMonthlyPolicy,,1689098017322.79dd09a662e99a3de62daf35d6a0df12., storeName=family1, fileCount=10, fileSize=49.7 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.2 K), priority=2, time=1689098028298; duration=0sec 2023-07-11 17:53:49,169 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-11 17:53:49,242 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithMonthlyPolicy/79dd09a662e99a3de62daf35d6a0df12/family1/d03d0fcae8564c21b214b65fb19f0db6, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithMonthlyPolicy/79dd09a662e99a3de62daf35d6a0df12/family1/bc7b51c5dc56481899f8f2a6f4f4e918, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithMonthlyPolicy/79dd09a662e99a3de62daf35d6a0df12/family1/e9b91e8334894185a887c51bd0ba07ce, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithMonthlyPolicy/79dd09a662e99a3de62daf35d6a0df12/family1/4280abce00b94726ab0934afc4f888c7, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithMonthlyPolicy/79dd09a662e99a3de62daf35d6a0df12/family1/91248b4f1cc5423e815c3a133fb4934c, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithMonthlyPolicy/79dd09a662e99a3de62daf35d6a0df12/family1/464d4e4ef75e499c8adace9f92a03059, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithMonthlyPolicy/79dd09a662e99a3de62daf35d6a0df12/family1/e00becb179d849fbb088cfb73286310b, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithMonthlyPolicy/79dd09a662e99a3de62daf35d6a0df12/family1/b38c880baa694e8f9ec0ed200ef1cb75, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithMonthlyPolicy/79dd09a662e99a3de62daf35d6a0df12/family1/020c1fe1c3fa452095b5aecbac1b90d1, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithMonthlyPolicy/79dd09a662e99a3de62daf35d6a0df12/family1/74ea44f2b1084a00a585f7672d042a5f_SeqId_44_] to archive 2023-07-11 17:53:49,243 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 17:53:49,245 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithMonthlyPolicy/79dd09a662e99a3de62daf35d6a0df12/family1/d03d0fcae8564c21b214b65fb19f0db6 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionWithMonthlyPolicy/79dd09a662e99a3de62daf35d6a0df12/family1/d03d0fcae8564c21b214b65fb19f0db6 2023-07-11 17:53:49,247 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithMonthlyPolicy/79dd09a662e99a3de62daf35d6a0df12/family1/bc7b51c5dc56481899f8f2a6f4f4e918 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionWithMonthlyPolicy/79dd09a662e99a3de62daf35d6a0df12/family1/bc7b51c5dc56481899f8f2a6f4f4e918 2023-07-11 17:53:49,248 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithMonthlyPolicy/79dd09a662e99a3de62daf35d6a0df12/family1/e9b91e8334894185a887c51bd0ba07ce to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionWithMonthlyPolicy/79dd09a662e99a3de62daf35d6a0df12/family1/e9b91e8334894185a887c51bd0ba07ce 2023-07-11 17:53:49,250 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithMonthlyPolicy/79dd09a662e99a3de62daf35d6a0df12/family1/4280abce00b94726ab0934afc4f888c7 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionWithMonthlyPolicy/79dd09a662e99a3de62daf35d6a0df12/family1/4280abce00b94726ab0934afc4f888c7 2023-07-11 17:53:49,251 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithMonthlyPolicy/79dd09a662e99a3de62daf35d6a0df12/family1/91248b4f1cc5423e815c3a133fb4934c to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionWithMonthlyPolicy/79dd09a662e99a3de62daf35d6a0df12/family1/91248b4f1cc5423e815c3a133fb4934c 2023-07-11 17:53:49,252 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithMonthlyPolicy/79dd09a662e99a3de62daf35d6a0df12/family1/464d4e4ef75e499c8adace9f92a03059 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionWithMonthlyPolicy/79dd09a662e99a3de62daf35d6a0df12/family1/464d4e4ef75e499c8adace9f92a03059 2023-07-11 17:53:49,253 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithMonthlyPolicy/79dd09a662e99a3de62daf35d6a0df12/family1/e00becb179d849fbb088cfb73286310b to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionWithMonthlyPolicy/79dd09a662e99a3de62daf35d6a0df12/family1/e00becb179d849fbb088cfb73286310b 2023-07-11 17:53:49,255 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithMonthlyPolicy/79dd09a662e99a3de62daf35d6a0df12/family1/b38c880baa694e8f9ec0ed200ef1cb75 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionWithMonthlyPolicy/79dd09a662e99a3de62daf35d6a0df12/family1/b38c880baa694e8f9ec0ed200ef1cb75 2023-07-11 17:53:49,256 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithMonthlyPolicy/79dd09a662e99a3de62daf35d6a0df12/family1/020c1fe1c3fa452095b5aecbac1b90d1 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionWithMonthlyPolicy/79dd09a662e99a3de62daf35d6a0df12/family1/020c1fe1c3fa452095b5aecbac1b90d1 2023-07-11 17:53:49,258 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithMonthlyPolicy/79dd09a662e99a3de62daf35d6a0df12/family1/74ea44f2b1084a00a585f7672d042a5f_SeqId_44_ to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionWithMonthlyPolicy/79dd09a662e99a3de62daf35d6a0df12/family1/74ea44f2b1084a00a585f7672d042a5f_SeqId_44_ 2023-07-11 17:53:49,259 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511308b2eff1a59964ae89bf2d8148f88d1c3 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511308b2eff1a59964ae89bf2d8148f88d1c3 2023-07-11 17:53:49,260 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-07-11 17:53:49,286 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/70a1f19a55be49ab836622df7f6a2a3b first=Optional[r00] last=Optional[r8] 2023-07-11 17:53:49,286 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1689098017322.79dd09a662e99a3de62daf35d6a0df12., hostname=jenkins-hbase9.apache.org,45839,1689097999112, seqNum=2 for row with hfile group [{family1,hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/70a1f19a55be49ab836622df7f6a2a3b}] 2023-07-11 17:53:49,288 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(763): Validating hfile at hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/70a1f19a55be49ab836622df7f6a2a3b for inclusion in 79dd09a662e99a3de62daf35d6a0df12/family1 2023-07-11 17:53:49,292 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(775): HFile bounds: first=r00 last=r8 2023-07-11 17:53:49,292 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(777): Region bounds: first= last= 2023-07-11 17:53:49,293 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HRegion(2446): Flush status journal for 79dd09a662e99a3de62daf35d6a0df12: 2023-07-11 17:53:49,293 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/70a1f19a55be49ab836622df7f6a2a3b to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testMajorCompactionWithMonthlyPolicy__b5mrq1qu6v2tmkrpedmslc46m4bpdrl3v25fs3212r5dcno5chth9jrj274cr9ub/family1/70a1f19a55be49ab836622df7f6a2a3b 2023-07-11 17:53:49,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testMajorCompactionWithMonthlyPolicy__b5mrq1qu6v2tmkrpedmslc46m4bpdrl3v25fs3212r5dcno5chth9jrj274cr9ub/family1/70a1f19a55be49ab836622df7f6a2a3b as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithMonthlyPolicy/79dd09a662e99a3de62daf35d6a0df12/family1/4958f56241954c68937c6a1696a653bc_SeqId_49_ 2023-07-11 17:53:49,296 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(849): Loaded HFile hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testMajorCompactionWithMonthlyPolicy__b5mrq1qu6v2tmkrpedmslc46m4bpdrl3v25fs3212r5dcno5chth9jrj274cr9ub/family1/70a1f19a55be49ab836622df7f6a2a3b into 79dd09a662e99a3de62daf35d6a0df12/family1 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithMonthlyPolicy/79dd09a662e99a3de62daf35d6a0df12/family1/4958f56241954c68937c6a1696a653bc_SeqId_49_ - updating store file list. 2023-07-11 17:53:49,302 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(882): Loaded HFile hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithMonthlyPolicy/79dd09a662e99a3de62daf35d6a0df12/family1/4958f56241954c68937c6a1696a653bc_SeqId_49_ into 79dd09a662e99a3de62daf35d6a0df12/family1 2023-07-11 17:53:49,302 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(855): Successfully loaded hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testMajorCompactionWithMonthlyPolicy__b5mrq1qu6v2tmkrpedmslc46m4bpdrl3v25fs3212r5dcno5chth9jrj274cr9ub/family1/70a1f19a55be49ab836622df7f6a2a3b into 79dd09a662e99a3de62daf35d6a0df12/family1 (new location: hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithMonthlyPolicy/79dd09a662e99a3de62daf35d6a0df12/family1/4958f56241954c68937c6a1696a653bc_SeqId_49_) 2023-07-11 17:53:49,303 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testMajorCompactionWithMonthlyPolicy__b5mrq1qu6v2tmkrpedmslc46m4bpdrl3v25fs3212r5dcno5chth9jrj274cr9ub/family1/70a1f19a55be49ab836622df7f6a2a3b 2023-07-11 17:53:49,303 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-07-11 17:53:49,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 352581 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-07-11 17:53:49,305 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(1912): 79dd09a662e99a3de62daf35d6a0df12/family1 is initiating minor compaction (all files) 2023-07-11 17:53:49,305 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@2416745a; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-11 17:53:49,305 INFO [RS:0;jenkins-hbase9:45839-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 79dd09a662e99a3de62daf35d6a0df12/family1 in testMajorCompactionWithMonthlyPolicy,,1689098017322.79dd09a662e99a3de62daf35d6a0df12. 2023-07-11 17:53:49,305 INFO [RS:0;jenkins-hbase9:45839-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithMonthlyPolicy/79dd09a662e99a3de62daf35d6a0df12/family1/021a0b89ab7640c49eebb9eb6ce83709, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithMonthlyPolicy/79dd09a662e99a3de62daf35d6a0df12/family1/fb0a1e2990f243fc8fd170d3e67a99bd, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithMonthlyPolicy/79dd09a662e99a3de62daf35d6a0df12/family1/f5da5b3f2d34457da5243617d05623f3_SeqId_46_, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithMonthlyPolicy/79dd09a662e99a3de62daf35d6a0df12/family1/4958f56241954c68937c6a1696a653bc_SeqId_49_] into tmpdir=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithMonthlyPolicy/79dd09a662e99a3de62daf35d6a0df12/.tmp, totalSize=344.3 K 2023-07-11 17:53:49,305 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] compactions.Compactor(207): Compacting 021a0b89ab7640c49eebb9eb6ce83709, keycount=1000, bloomtype=ROW, size=166.0 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878822106 2023-07-11 17:53:49,306 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] compactions.Compactor(207): Compacting fb0a1e2990f243fc8fd170d3e67a99bd, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621222106 2023-07-11 17:53:49,306 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] compactions.Compactor(207): Compacting f5da5b3f2d34457da5243617d05623f3_SeqId_46_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=47, earliestPutTs=1448965222106 2023-07-11 17:53:49,307 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-07-11 17:53:49,307 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] compactions.Compactor(207): Compacting 4958f56241954c68937c6a1696a653bc_SeqId_49_, keycount=1001, bloomtype=ROW, size=166.2 K, encoding=NONE, compression=NONE, seqNum=50, earliestPutTs=1448014822106 2023-07-11 17:53:49,307 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 17:53:49,309 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151120ce612cb6b2cc4945a3eb7d2116df2df3 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151120ce612cb6b2cc4945a3eb7d2116df2df3 2023-07-11 17:53:49,311 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511282146e245cda64674bc7518cf4b35c26e to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511282146e245cda64674bc7518cf4b35c26e 2023-07-11 17:53:49,312 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511306ab0d93542a247ea90bb30a8bbe51743 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511306ab0d93542a247ea90bb30a8bbe51743 2023-07-11 17:53:49,312 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 3 expired mob files are deleted 2023-07-11 17:53:49,313 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-07-11 17:53:49,313 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-07-11 17:53:49,313 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-07-11 17:53:49,313 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-07-11 17:53:49,313 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-07-11 17:53:49,313 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithMonthlyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-07-11 17:53:49,314 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=22, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-07-11 17:53:49,316 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=22, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE in 1.9230 sec 2023-07-11 17:53:49,332 INFO [RS:0;jenkins-hbase9:45839-shortCompactions-0] throttle.PressureAwareThroughputController(145): 79dd09a662e99a3de62daf35d6a0df12#family1#compaction#23 average throughput is 12.97 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-11 17:53:49,429 INFO [Listener at localhost/43271] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithMonthlyPolicy Thread=263 (was 250) Potentially hanging thread: hconnection-0x786c85d7-shared-pool-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2145606250_17 at /127.0.0.1:53482 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2145606250_17 at /127.0.0.1:53498 [Waiting for operation #17] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2145606250_17 at /127.0.0.1:53314 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x786c85d7-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:50702@0x243d5bfb-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: hconnection-0x786c85d7-shared-pool-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-643365118_17 at /127.0.0.1:53574 [Receiving block BP-735400681-172.31.2.10-1689097994513:blk_1073741900_1076] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read1(BufferedInputStream.java:286) java.io.BufferedInputStream.read(BufferedInputStream.java:345) java.io.DataInputStream.read(DataInputStream.java:149) org.apache.hadoop.io.IOUtils.readFully(IOUtils.java:209) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doReadFully(PacketReceiver.java:211) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doRead(PacketReceiver.java:134) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.receiveNextPacket(PacketReceiver.java:109) org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receivePacket(BlockReceiver.java:528) org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receiveBlock(BlockReceiver.java:968) org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:877) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.opWriteBlock(Receiver.java:166) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.processOp(Receiver.java:103) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:290) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1c25ffca-shared-pool-23 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2145606250_17 at /127.0.0.1:53330 [Waiting for operation #12] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2145606250_17 at /127.0.0.1:53460 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2145606250_17 at /127.0.0.1:53338 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2145606250_17 at /127.0.0.1:53392 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2145606250_17 at /127.0.0.1:53472 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: PacketResponder: BP-735400681-172.31.2.10-1689097994513:blk_1073741900_1076, type=LAST_IN_PIPELINE java.lang.Object.wait(Native Method) java.lang.Object.wait(Object.java:502) org.apache.hadoop.hdfs.server.datanode.BlockReceiver$PacketResponder.waitForAckHead(BlockReceiver.java:1327) org.apache.hadoop.hdfs.server.datanode.BlockReceiver$PacketResponder.run(BlockReceiver.java:1399) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:50702@0x243d5bfb-SendThread(127.0.0.1:50702) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2145606250_17 at /127.0.0.1:53404 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2145606250_17 at /127.0.0.1:53254 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x786c85d7-shared-pool-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-643365118_17 at /127.0.0.1:53562 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/0ffa2fd0-9ac7-3acf-2d07-d63463e28c78/cluster_34dba087-9207-891f-190b-e8a2fc02141e/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2145606250_17 at /127.0.0.1:53386 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:50702@0x243d5bfb sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$46/980716329.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/0ffa2fd0-9ac7-3acf-2d07-d63463e28c78/cluster_34dba087-9207-891f-190b-e8a2fc02141e/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x786c85d7-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ResponseProcessor for block BP-735400681-172.31.2.10-1689097994513:blk_1073741900_1076 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:118) java.io.FilterInputStream.read(FilterInputStream.java:83) java.io.FilterInputStream.read(FilterInputStream.java:83) org.apache.hadoop.hdfs.protocolPB.PBHelperClient.vintPrefixed(PBHelperClient.java:454) org.apache.hadoop.hdfs.protocol.datatransfer.PipelineAck.readFields(PipelineAck.java:213) org.apache.hadoop.hdfs.DataStreamer$ResponseProcessor.run(DataStreamer.java:1080) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2145606250_17 at /127.0.0.1:53352 [Waiting for operation #15] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2145606250_17 at /127.0.0.1:53554 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2145606250_17 at /127.0.0.1:53426 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataStreamer for file /user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130093706e1938242d388d1da9fc8640a0b_del java.lang.Object.wait(Native Method) org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:678) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2145606250_17 at /127.0.0.1:53292 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2145606250_17 at /127.0.0.1:53448 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataStreamer for file /user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithMonthlyPolicy/79dd09a662e99a3de62daf35d6a0df12/.tmp/family1/1ff442d53cb14caf9eb2c794faa548cc block BP-735400681-172.31.2.10-1689097994513:blk_1073741900_1076 java.lang.Object.wait(Native Method) org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:678) Potentially hanging thread: hconnection-0x786c85d7-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-489 java.lang.Object.wait(Native Method) org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:678) Potentially hanging thread: hconnection-0x786c85d7-shared-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=617 (was 589) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=211 (was 231), ProcessCount=170 (was 170), AvailableMemoryMB=8850 (was 8896) 2023-07-11 17:53:49,445 INFO [Listener at localhost/43271] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompactionWithWeeklyPolicy Thread=262, OpenFileDescriptor=617, MaxFileDescriptor=60000, SystemLoadAverage=211, ProcessCount=170, AvailableMemoryMB=8850 2023-07-11 17:53:49,447 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testMinorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-07-11 17:53:49,448 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure2.ProcedureExecutor(1029): Stored pid=23, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:49,450 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-07-11 17:53:49,450 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testMinorCompactionWithWeeklyPolicy" procId is: 23 2023-07-11 17:53:49,451 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-11 17:53:49,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-07-11 17:53:49,453 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/fcc1e02fb516934639a517c1444369be 2023-07-11 17:53:49,453 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/fcc1e02fb516934639a517c1444369be empty. 2023-07-11 17:53:49,454 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/fcc1e02fb516934639a517c1444369be 2023-07-11 17:53:49,454 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testMinorCompactionWithWeeklyPolicy regions 2023-07-11 17:53:49,552 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-07-11 17:53:49,754 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-07-11 17:53:49,865 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/.tabledesc/.tableinfo.0000000001 2023-07-11 17:53:49,866 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => fcc1e02fb516934639a517c1444369be, NAME => 'testMinorCompactionWithWeeklyPolicy,,1689098029447.fcc1e02fb516934639a517c1444369be.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMinorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/.tmp 2023-07-11 17:53:50,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-07-11 17:53:50,274 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithWeeklyPolicy,,1689098029447.fcc1e02fb516934639a517c1444369be.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 17:53:50,274 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1604): Closing fcc1e02fb516934639a517c1444369be, disabling compactions & flushes 2023-07-11 17:53:50,274 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithWeeklyPolicy,,1689098029447.fcc1e02fb516934639a517c1444369be. 2023-07-11 17:53:50,274 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithWeeklyPolicy,,1689098029447.fcc1e02fb516934639a517c1444369be. 2023-07-11 17:53:50,274 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithWeeklyPolicy,,1689098029447.fcc1e02fb516934639a517c1444369be. after waiting 0 ms 2023-07-11 17:53:50,274 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithWeeklyPolicy,,1689098029447.fcc1e02fb516934639a517c1444369be. 2023-07-11 17:53:50,274 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1838): Closed testMinorCompactionWithWeeklyPolicy,,1689098029447.fcc1e02fb516934639a517c1444369be. 2023-07-11 17:53:50,274 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for fcc1e02fb516934639a517c1444369be: 2023-07-11 17:53:50,277 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-07-11 17:53:50,278 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMinorCompactionWithWeeklyPolicy,,1689098029447.fcc1e02fb516934639a517c1444369be.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1689098030277"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689098030277"}]},"ts":"1689098030277"} 2023-07-11 17:53:50,279 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-11 17:53:50,280 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-11 17:53:50,280 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689098030280"}]},"ts":"1689098030280"} 2023-07-11 17:53:50,281 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithWeeklyPolicy, state=ENABLING in hbase:meta 2023-07-11 17:53:50,288 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=fcc1e02fb516934639a517c1444369be, ASSIGN}] 2023-07-11 17:53:50,290 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=fcc1e02fb516934639a517c1444369be, ASSIGN 2023-07-11 17:53:50,291 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=fcc1e02fb516934639a517c1444369be, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,45839,1689097999112; forceNewPlan=false, retain=false 2023-07-11 17:53:50,442 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=fcc1e02fb516934639a517c1444369be, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:50,442 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMinorCompactionWithWeeklyPolicy,,1689098029447.fcc1e02fb516934639a517c1444369be.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1689098030442"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689098030442"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689098030442"}]},"ts":"1689098030442"} 2023-07-11 17:53:50,444 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=24, state=RUNNABLE; OpenRegionProcedure fcc1e02fb516934639a517c1444369be, server=jenkins-hbase9.apache.org,45839,1689097999112}] 2023-07-11 17:53:50,555 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithMonthlyPolicy/79dd09a662e99a3de62daf35d6a0df12/.tmp/family1/1ff442d53cb14caf9eb2c794faa548cc as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithMonthlyPolicy/79dd09a662e99a3de62daf35d6a0df12/family1/1ff442d53cb14caf9eb2c794faa548cc 2023-07-11 17:53:50,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-07-11 17:53:50,561 INFO [RS:0;jenkins-hbase9:45839-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 79dd09a662e99a3de62daf35d6a0df12/family1 of 79dd09a662e99a3de62daf35d6a0df12 into 1ff442d53cb14caf9eb2c794faa548cc(size=167.4 K), total size for store is 167.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-07-11 17:53:50,562 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 79dd09a662e99a3de62daf35d6a0df12: 2023-07-11 17:53:50,562 INFO [RS:0;jenkins-hbase9:45839-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithMonthlyPolicy,,1689098017322.79dd09a662e99a3de62daf35d6a0df12., storeName=family1, fileCount=4, fileSize=344.3 K (166.0 K, 6.6 K, 5.5 K, 166.2 K), priority=2, time=1689098029305; duration=1sec 2023-07-11 17:53:50,562 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-11 17:53:50,600 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testMinorCompactionWithWeeklyPolicy,,1689098029447.fcc1e02fb516934639a517c1444369be. 2023-07-11 17:53:50,600 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => fcc1e02fb516934639a517c1444369be, NAME => 'testMinorCompactionWithWeeklyPolicy,,1689098029447.fcc1e02fb516934639a517c1444369be.', STARTKEY => '', ENDKEY => ''} 2023-07-11 17:53:50,600 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompactionWithWeeklyPolicy fcc1e02fb516934639a517c1444369be 2023-07-11 17:53:50,600 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithWeeklyPolicy,,1689098029447.fcc1e02fb516934639a517c1444369be.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 17:53:50,600 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for fcc1e02fb516934639a517c1444369be 2023-07-11 17:53:50,600 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for fcc1e02fb516934639a517c1444369be 2023-07-11 17:53:50,602 INFO [StoreOpener-fcc1e02fb516934639a517c1444369be-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region fcc1e02fb516934639a517c1444369be 2023-07-11 17:53:50,603 DEBUG [StoreOpener-fcc1e02fb516934639a517c1444369be-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithWeeklyPolicy/fcc1e02fb516934639a517c1444369be/family1 2023-07-11 17:53:50,603 DEBUG [StoreOpener-fcc1e02fb516934639a517c1444369be-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithWeeklyPolicy/fcc1e02fb516934639a517c1444369be/family1 2023-07-11 17:53:50,604 INFO [StoreOpener-fcc1e02fb516934639a517c1444369be-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fcc1e02fb516934639a517c1444369be columnFamilyName family1 2023-07-11 17:53:50,605 INFO [StoreOpener-fcc1e02fb516934639a517c1444369be-1] regionserver.HStore(310): Store=fcc1e02fb516934639a517c1444369be/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 17:53:50,606 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithWeeklyPolicy/fcc1e02fb516934639a517c1444369be 2023-07-11 17:53:50,606 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithWeeklyPolicy/fcc1e02fb516934639a517c1444369be 2023-07-11 17:53:50,609 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for fcc1e02fb516934639a517c1444369be 2023-07-11 17:53:50,611 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithWeeklyPolicy/fcc1e02fb516934639a517c1444369be/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 17:53:50,612 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened fcc1e02fb516934639a517c1444369be; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69314967, jitterRate=0.032873496413230896}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 17:53:50,612 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for fcc1e02fb516934639a517c1444369be: 2023-07-11 17:53:50,613 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMinorCompactionWithWeeklyPolicy,,1689098029447.fcc1e02fb516934639a517c1444369be., pid=25, masterSystemTime=1689098030597 2023-07-11 17:53:50,615 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMinorCompactionWithWeeklyPolicy,,1689098029447.fcc1e02fb516934639a517c1444369be. 2023-07-11 17:53:50,615 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testMinorCompactionWithWeeklyPolicy,,1689098029447.fcc1e02fb516934639a517c1444369be. 2023-07-11 17:53:50,615 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=fcc1e02fb516934639a517c1444369be, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:50,615 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMinorCompactionWithWeeklyPolicy,,1689098029447.fcc1e02fb516934639a517c1444369be.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1689098030615"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689098030615"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689098030615"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689098030615"}]},"ts":"1689098030615"} 2023-07-11 17:53:50,619 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=24 2023-07-11 17:53:50,619 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=24, state=SUCCESS; OpenRegionProcedure fcc1e02fb516934639a517c1444369be, server=jenkins-hbase9.apache.org,45839,1689097999112 in 173 msec 2023-07-11 17:53:50,621 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=23 2023-07-11 17:53:50,621 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=23, state=SUCCESS; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=fcc1e02fb516934639a517c1444369be, ASSIGN in 331 msec 2023-07-11 17:53:50,622 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-11 17:53:50,622 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689098030622"}]},"ts":"1689098030622"} 2023-07-11 17:53:50,624 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithWeeklyPolicy, state=ENABLED in hbase:meta 2023-07-11 17:53:50,626 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-07-11 17:53:50,628 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=23, state=SUCCESS; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy in 1.1790 sec 2023-07-11 17:53:50,638 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithMonthlyPolicy/79dd09a662e99a3de62daf35d6a0df12/family1/021a0b89ab7640c49eebb9eb6ce83709, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithMonthlyPolicy/79dd09a662e99a3de62daf35d6a0df12/family1/fb0a1e2990f243fc8fd170d3e67a99bd, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithMonthlyPolicy/79dd09a662e99a3de62daf35d6a0df12/family1/f5da5b3f2d34457da5243617d05623f3_SeqId_46_, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithMonthlyPolicy/79dd09a662e99a3de62daf35d6a0df12/family1/4958f56241954c68937c6a1696a653bc_SeqId_49_] to archive 2023-07-11 17:53:50,639 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 17:53:50,641 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithMonthlyPolicy/79dd09a662e99a3de62daf35d6a0df12/family1/021a0b89ab7640c49eebb9eb6ce83709 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionWithMonthlyPolicy/79dd09a662e99a3de62daf35d6a0df12/family1/021a0b89ab7640c49eebb9eb6ce83709 2023-07-11 17:53:50,643 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithMonthlyPolicy/79dd09a662e99a3de62daf35d6a0df12/family1/fb0a1e2990f243fc8fd170d3e67a99bd to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionWithMonthlyPolicy/79dd09a662e99a3de62daf35d6a0df12/family1/fb0a1e2990f243fc8fd170d3e67a99bd 2023-07-11 17:53:50,644 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithMonthlyPolicy/79dd09a662e99a3de62daf35d6a0df12/family1/f5da5b3f2d34457da5243617d05623f3_SeqId_46_ to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionWithMonthlyPolicy/79dd09a662e99a3de62daf35d6a0df12/family1/f5da5b3f2d34457da5243617d05623f3_SeqId_46_ 2023-07-11 17:53:50,645 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithMonthlyPolicy/79dd09a662e99a3de62daf35d6a0df12/family1/4958f56241954c68937c6a1696a653bc_SeqId_49_ to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionWithMonthlyPolicy/79dd09a662e99a3de62daf35d6a0df12/family1/4958f56241954c68937c6a1696a653bc_SeqId_49_ 2023-07-11 17:53:51,557 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-07-11 17:53:51,557 INFO [Listener at localhost/43271] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMinorCompactionWithWeeklyPolicy, procId: 23 completed 2023-07-11 17:53:51,580 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 17:53:51,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:51,582 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-07-11 17:53:51,583 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:53:51,583 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-07-11 17:53:51,583 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-07-11 17:53:51,583 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:51,583 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:51,584 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:53:51,584 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:51,585 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:53:51,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:53:51,585 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:51,585 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 17:53:51,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:51,585 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:51,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 17:53:51,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:51,586 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:51,586 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:51,586 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-07-11 17:53:51,586 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:53:51,586 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-07-11 17:53:51,586 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 17:53:51,586 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 17:53:51,587 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1689098029447.fcc1e02fb516934639a517c1444369be. 2023-07-11 17:53:51,587 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1689098029447.fcc1e02fb516934639a517c1444369be. started... 2023-07-11 17:53:51,588 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing fcc1e02fb516934639a517c1444369be 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-07-11 17:53:52,011 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511307d543f57a0d8456c8810abea6339a676 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201511307d543f57a0d8456c8810abea6339a676 2023-07-11 17:53:52,415 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithWeeklyPolicy/fcc1e02fb516934639a517c1444369be/.tmp/family1/067a62272e0a43859a103621d085cd78 2023-07-11 17:53:52,421 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithWeeklyPolicy/fcc1e02fb516934639a517c1444369be/.tmp/family1/067a62272e0a43859a103621d085cd78 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithWeeklyPolicy/fcc1e02fb516934639a517c1444369be/family1/067a62272e0a43859a103621d085cd78 2023-07-11 17:53:52,426 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithWeeklyPolicy/fcc1e02fb516934639a517c1444369be/family1/067a62272e0a43859a103621d085cd78, entries=1000, sequenceid=5, filesize=165.1 K 2023-07-11 17:53:52,427 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for fcc1e02fb516934639a517c1444369be in 840ms, sequenceid=5, compaction requested=false 2023-07-11 17:53:52,427 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMinorCompactionWithWeeklyPolicy' 2023-07-11 17:53:52,428 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for fcc1e02fb516934639a517c1444369be: 2023-07-11 17:53:52,428 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1689098029447.fcc1e02fb516934639a517c1444369be. 2023-07-11 17:53:52,428 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 17:53:52,428 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 17:53:52,428 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:52,428 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-07-11 17:53:52,428 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-07-11 17:53:52,430 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:52,430 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:52,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:52,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:53:52,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:53:52,430 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:52,430 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 17:53:52,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:53:52,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:53:52,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:52,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:52,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:53:52,431 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-07-11 17:53:52,431 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3d6bf7c3[Count = 0] remaining members to acquire global barrier 2023-07-11 17:53:52,431 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-07-11 17:53:52,431 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:52,433 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:52,433 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:52,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:52,433 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-07-11 17:53:52,433 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-07-11 17:53:52,433 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase9.apache.org,45839,1689097999112' in zk 2023-07-11 17:53:52,433 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:52,433 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 17:53:52,434 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-07-11 17:53:52,434 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:52,434 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:53:52,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:52,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:53:52,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:53:52,434 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-07-11 17:53:52,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:53:52,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:53:52,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:52,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:52,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:53:52,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:52,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:52,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase9.apache.org,45839,1689097999112': 2023-07-11 17:53:52,436 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-07-11 17:53:52,436 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-07-11 17:53:52,436 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 17:53:52,437 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 17:53:52,437 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:52,437 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 17:53:52,439 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:52,439 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:52,439 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:52,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:52,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:52,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:53:52,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:53:52,439 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:53:52,439 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:53:52,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:53:52,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:53:52,440 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:52,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:52,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:52,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:53:52,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:52,441 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:52,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:52,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:53:52,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:52,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:52,443 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:52,443 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:53:52,443 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:52,443 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:53:52,443 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:53:52,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:53:52,443 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:53:52,443 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-07-11 17:53:52,443 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 17:53:52,443 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:52,443 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:52,443 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:52,443 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-07-11 17:53:52,443 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:52,443 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:53:52,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:53:52,443 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:52,443 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-07-11 17:53:52,444 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 17:53:52,544 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 17:53:52,545 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 17:53:52,549 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 17:53:52,551 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-07-11 17:53:52,551 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:52,551 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-07-11 17:53:52,551 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:53:52,551 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-07-11 17:53:52,551 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-07-11 17:53:52,551 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:52,551 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:52,553 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:53:52,553 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:52,553 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:53:52,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:53:52,553 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:52,553 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 17:53:52,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:52,554 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:52,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 17:53:52,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:52,554 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:52,554 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-07-11 17:53:52,554 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:52,555 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-07-11 17:53:52,555 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:53:52,555 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-07-11 17:53:52,555 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 17:53:52,555 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 17:53:52,555 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1689098029447.fcc1e02fb516934639a517c1444369be. 2023-07-11 17:53:52,555 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1689098029447.fcc1e02fb516934639a517c1444369be. started... 2023-07-11 17:53:52,555 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing fcc1e02fb516934639a517c1444369be 1/1 column families, dataSize=74 B heapSize=408 B 2023-07-11 17:53:52,969 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128fc7d1324d0bd4a87badff730e518ff7d to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151128fc7d1324d0bd4a87badff730e518ff7d 2023-07-11 17:53:53,375 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithWeeklyPolicy/fcc1e02fb516934639a517c1444369be/.tmp/family1/131c3866ae92404ba053928539ef1f0a 2023-07-11 17:53:53,381 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithWeeklyPolicy/fcc1e02fb516934639a517c1444369be/.tmp/family1/131c3866ae92404ba053928539ef1f0a as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithWeeklyPolicy/fcc1e02fb516934639a517c1444369be/family1/131c3866ae92404ba053928539ef1f0a 2023-07-11 17:53:53,386 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithWeeklyPolicy/fcc1e02fb516934639a517c1444369be/family1/131c3866ae92404ba053928539ef1f0a, entries=1, sequenceid=9, filesize=5.0 K 2023-07-11 17:53:53,387 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for fcc1e02fb516934639a517c1444369be in 832ms, sequenceid=9, compaction requested=false 2023-07-11 17:53:53,387 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for fcc1e02fb516934639a517c1444369be: 2023-07-11 17:53:53,387 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1689098029447.fcc1e02fb516934639a517c1444369be. 2023-07-11 17:53:53,387 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 17:53:53,387 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 17:53:53,387 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:53,388 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-07-11 17:53:53,388 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-07-11 17:53:53,389 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:53,389 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:53,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:53,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:53:53,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:53:53,389 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:53,389 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 17:53:53,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:53:53,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:53:53,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:53,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:53,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:53:53,391 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-07-11 17:53:53,391 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@74f9651c[Count = 0] remaining members to acquire global barrier 2023-07-11 17:53:53,391 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-07-11 17:53:53,391 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:53,393 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:53,393 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:53,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:53,393 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-07-11 17:53:53,393 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-07-11 17:53:53,393 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:53,393 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 17:53:53,393 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase9.apache.org,45839,1689097999112' in zk 2023-07-11 17:53:53,394 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-07-11 17:53:53,394 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:53,394 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:53:53,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:53,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:53:53,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:53:53,394 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-07-11 17:53:53,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:53:53,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:53:53,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:53,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:53,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:53:53,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:53,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:53,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase9.apache.org,45839,1689097999112': 2023-07-11 17:53:53,397 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-07-11 17:53:53,397 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-07-11 17:53:53,397 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 17:53:53,397 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 17:53:53,397 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:53,397 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 17:53:53,398 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:53,398 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:53,398 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:53:53,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:53,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:53:53,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:53:53,398 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:53,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:53,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:53:53,399 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:53:53,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:53:53,399 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:53,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:53,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:53,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:53:53,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:53,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:53,400 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:53,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:53:53,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:53,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:53,402 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:53,402 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:53:53,402 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:53,402 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:53:53,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:53:53,402 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:53:53,402 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:53:53,402 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-07-11 17:53:53,402 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-07-11 17:53:53,402 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 17:53:53,402 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:53:53,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:53:53,402 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:53,402 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:53,402 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:53,403 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:53,403 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:53,403 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-07-11 17:53:53,403 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 17:53:53,503 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 17:53:53,504 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 17:53:53,508 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 17:53:53,510 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-07-11 17:53:53,510 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:53,510 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-07-11 17:53:53,510 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:53:53,510 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-07-11 17:53:53,510 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-07-11 17:53:53,510 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:53,510 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:53,513 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:53,513 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:53:53,513 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:53:53,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:53:53,513 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:53,513 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 17:53:53,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:53,514 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:53,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 17:53:53,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:53,514 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:53,514 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-07-11 17:53:53,514 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:53,514 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-07-11 17:53:53,515 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:53:53,515 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-07-11 17:53:53,515 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 17:53:53,515 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 17:53:53,515 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1689098029447.fcc1e02fb516934639a517c1444369be. 2023-07-11 17:53:53,515 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1689098029447.fcc1e02fb516934639a517c1444369be. started... 2023-07-11 17:53:53,515 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing fcc1e02fb516934639a517c1444369be 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-11 17:53:53,929 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201813bc7282fd243b7b131a8050a8c434d to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151201813bc7282fd243b7b131a8050a8c434d 2023-07-11 17:53:53,934 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithWeeklyPolicy/fcc1e02fb516934639a517c1444369be/.tmp/family1/eb49c6ddce3c4bd9989d27c2fa481ebb 2023-07-11 17:53:53,939 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithWeeklyPolicy/fcc1e02fb516934639a517c1444369be/.tmp/family1/eb49c6ddce3c4bd9989d27c2fa481ebb as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithWeeklyPolicy/fcc1e02fb516934639a517c1444369be/family1/eb49c6ddce3c4bd9989d27c2fa481ebb 2023-07-11 17:53:53,943 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithWeeklyPolicy/fcc1e02fb516934639a517c1444369be/family1/eb49c6ddce3c4bd9989d27c2fa481ebb, entries=1, sequenceid=13, filesize=4.9 K 2023-07-11 17:53:53,945 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for fcc1e02fb516934639a517c1444369be in 429ms, sequenceid=13, compaction requested=true 2023-07-11 17:53:53,945 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for fcc1e02fb516934639a517c1444369be: 2023-07-11 17:53:53,945 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1689098029447.fcc1e02fb516934639a517c1444369be. 2023-07-11 17:53:53,945 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 17:53:53,945 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 17:53:53,945 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:53,945 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-07-11 17:53:53,946 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-07-11 17:53:53,947 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:53,947 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:53,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:53,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:53:53,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:53:53,947 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:53,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:53:53,947 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 17:53:53,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:53:53,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:53,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:53,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:53:53,949 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-07-11 17:53:53,949 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5e2316dd[Count = 0] remaining members to acquire global barrier 2023-07-11 17:53:53,949 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-07-11 17:53:53,949 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:53,950 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:53,950 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:53,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:53,950 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-07-11 17:53:53,950 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-07-11 17:53:53,950 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase9.apache.org,45839,1689097999112' in zk 2023-07-11 17:53:53,950 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:53,950 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 17:53:53,951 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:53,951 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-07-11 17:53:53,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:53,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:53:53,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:53:53,951 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:53:53,951 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-07-11 17:53:53,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:53:53,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:53:53,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:53,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:53,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:53:53,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:53,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:53,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase9.apache.org,45839,1689097999112': 2023-07-11 17:53:53,953 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-07-11 17:53:53,953 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-07-11 17:53:53,953 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 17:53:53,953 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 17:53:53,953 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:53,953 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 17:53:53,956 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:53,956 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:53,956 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:53:53,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:53,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:53:53,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:53:53,956 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:53,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:53,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:53:53,956 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:53:53,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:53:53,956 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:53,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:53,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:53,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:53:53,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:53,958 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:53,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:53,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:53:53,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:53,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:53,962 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:53,962 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:53:53,962 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:53,962 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:53:53,962 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-07-11 17:53:53,962 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:53,962 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-07-11 17:53:53,962 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 17:53:53,962 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:53:53,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:53:53,962 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:53:53,962 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:53,963 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:53,963 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:53,963 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:53,963 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-07-11 17:53:53,963 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 17:53:53,963 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:53:53,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:53:54,063 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 17:53:54,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 17:53:54,068 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 17:53:54,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-07-11 17:53:54,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:54,070 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-07-11 17:53:54,070 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:53:54,070 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-07-11 17:53:54,070 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-07-11 17:53:54,071 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:54,071 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:54,072 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:54,072 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:53:54,072 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:53:54,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:53:54,072 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:54,072 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 17:53:54,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:54,073 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:54,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 17:53:54,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:54,073 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:54,073 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-07-11 17:53:54,073 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:54,073 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-07-11 17:53:54,073 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:53:54,073 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-07-11 17:53:54,073 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 17:53:54,074 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 17:53:54,074 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1689098029447.fcc1e02fb516934639a517c1444369be. 2023-07-11 17:53:54,074 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1689098029447.fcc1e02fb516934639a517c1444369be. started... 2023-07-11 17:53:54,074 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing fcc1e02fb516934639a517c1444369be 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-11 17:53:54,488 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205a345d834f9b6487ea13747af9fdd0a64 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151205a345d834f9b6487ea13747af9fdd0a64 2023-07-11 17:53:54,894 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithWeeklyPolicy/fcc1e02fb516934639a517c1444369be/.tmp/family1/b4a244b4ed7b4b0baf639c5afd5a19ce 2023-07-11 17:53:54,900 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithWeeklyPolicy/fcc1e02fb516934639a517c1444369be/.tmp/family1/b4a244b4ed7b4b0baf639c5afd5a19ce as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithWeeklyPolicy/fcc1e02fb516934639a517c1444369be/family1/b4a244b4ed7b4b0baf639c5afd5a19ce 2023-07-11 17:53:54,904 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithWeeklyPolicy/fcc1e02fb516934639a517c1444369be/family1/b4a244b4ed7b4b0baf639c5afd5a19ce, entries=1, sequenceid=17, filesize=4.9 K 2023-07-11 17:53:54,905 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for fcc1e02fb516934639a517c1444369be in 831ms, sequenceid=17, compaction requested=true 2023-07-11 17:53:54,905 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for fcc1e02fb516934639a517c1444369be: 2023-07-11 17:53:54,905 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1689098029447.fcc1e02fb516934639a517c1444369be. 2023-07-11 17:53:54,906 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 17:53:54,906 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 17:53:54,906 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:54,906 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-07-11 17:53:54,906 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-07-11 17:53:54,908 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:54,908 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:54,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:54,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:53:54,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:53:54,908 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:54,908 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 17:53:54,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:53:54,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:53:54,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:54,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:54,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:53:54,910 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-07-11 17:53:54,910 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5e839fab[Count = 0] remaining members to acquire global barrier 2023-07-11 17:53:54,910 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-07-11 17:53:54,910 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:54,911 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:54,911 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:54,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:54,911 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-07-11 17:53:54,911 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-07-11 17:53:54,911 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase9.apache.org,45839,1689097999112' in zk 2023-07-11 17:53:54,911 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:54,911 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 17:53:54,912 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-07-11 17:53:54,912 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:53:54,912 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:54,912 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-07-11 17:53:54,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:54,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:53:54,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:53:54,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:53:54,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:53:54,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:54,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:54,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:53:54,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:54,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:54,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase9.apache.org,45839,1689097999112': 2023-07-11 17:53:54,915 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-07-11 17:53:54,915 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-07-11 17:53:54,915 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 17:53:54,915 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 17:53:54,915 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:54,915 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 17:53:54,916 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:54,916 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:54,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:54,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:53:54,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:53:54,916 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:53:54,916 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:54,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:54,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:53:54,917 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:53:54,917 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:54,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:53:54,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:54,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:54,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:53:54,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:54,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:54,918 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:54,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:53:54,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:54,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:54,921 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:54,921 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:53:54,921 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:54,921 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:53:54,921 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:53:54,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:53:54,921 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-07-11 17:53:54,921 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 17:53:54,921 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:53:54,921 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:54,921 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:54,921 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:53:54,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:53:54,921 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:54,921 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-07-11 17:53:54,921 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:54,921 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 17:53:54,921 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:55,022 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 17:53:55,023 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 17:53:55,027 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 17:53:55,028 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-07-11 17:53:55,028 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:55,028 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-07-11 17:53:55,028 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:53:55,028 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-07-11 17:53:55,028 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-07-11 17:53:55,029 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:55,029 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:55,030 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:55,030 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:53:55,030 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:53:55,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:53:55,030 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:55,030 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 17:53:55,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:55,031 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:55,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 17:53:55,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:55,031 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:55,031 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-07-11 17:53:55,031 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:55,031 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-07-11 17:53:55,031 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:53:55,031 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-07-11 17:53:55,032 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 17:53:55,032 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 17:53:55,032 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1689098029447.fcc1e02fb516934639a517c1444369be. 2023-07-11 17:53:55,032 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1689098029447.fcc1e02fb516934639a517c1444369be. started... 2023-07-11 17:53:55,032 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing fcc1e02fb516934639a517c1444369be 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-11 17:53:55,446 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512283ef4204f9e7c40d0a096af6afa75d51a to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512283ef4204f9e7c40d0a096af6afa75d51a 2023-07-11 17:53:55,852 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithWeeklyPolicy/fcc1e02fb516934639a517c1444369be/.tmp/family1/9cb8e805448d4e14a303fb14d6a74749 2023-07-11 17:53:55,858 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithWeeklyPolicy/fcc1e02fb516934639a517c1444369be/.tmp/family1/9cb8e805448d4e14a303fb14d6a74749 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithWeeklyPolicy/fcc1e02fb516934639a517c1444369be/family1/9cb8e805448d4e14a303fb14d6a74749 2023-07-11 17:53:55,862 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithWeeklyPolicy/fcc1e02fb516934639a517c1444369be/family1/9cb8e805448d4e14a303fb14d6a74749, entries=1, sequenceid=21, filesize=4.9 K 2023-07-11 17:53:55,863 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for fcc1e02fb516934639a517c1444369be in 831ms, sequenceid=21, compaction requested=true 2023-07-11 17:53:55,863 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for fcc1e02fb516934639a517c1444369be: 2023-07-11 17:53:55,863 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1689098029447.fcc1e02fb516934639a517c1444369be. 2023-07-11 17:53:55,863 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 17:53:55,864 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 17:53:55,864 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:55,864 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-07-11 17:53:55,864 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-07-11 17:53:55,865 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:55,865 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:55,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:55,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:53:55,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:53:55,865 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:55,866 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 17:53:55,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:53:55,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:53:55,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:55,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:55,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:53:55,867 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-07-11 17:53:55,867 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-07-11 17:53:55,867 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3c34ae57[Count = 0] remaining members to acquire global barrier 2023-07-11 17:53:55,867 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:55,868 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:55,868 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:55,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:55,868 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-07-11 17:53:55,868 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-07-11 17:53:55,868 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase9.apache.org,45839,1689097999112' in zk 2023-07-11 17:53:55,868 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:55,868 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 17:53:55,870 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-07-11 17:53:55,870 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:53:55,870 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:55,871 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-07-11 17:53:55,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:55,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:53:55,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:53:55,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:53:55,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:53:55,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:55,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:55,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:53:55,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:55,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:55,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase9.apache.org,45839,1689097999112': 2023-07-11 17:53:55,873 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-07-11 17:53:55,873 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-07-11 17:53:55,873 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 17:53:55,873 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 17:53:55,873 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:55,873 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 17:53:55,875 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:55,875 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:55,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:55,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:53:55,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:53:55,875 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:55,875 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:53:55,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:55,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:53:55,875 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:53:55,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:53:55,875 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:55,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:55,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:55,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:53:55,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:55,877 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:55,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:55,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:53:55,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:55,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:55,879 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:55,879 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:55,879 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:53:55,879 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:55,879 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-07-11 17:53:55,879 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 17:53:55,879 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:55,879 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:53:55,879 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:55,879 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:53:55,879 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:55,879 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:53:55,879 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-07-11 17:53:55,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:53:55,879 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-07-11 17:53:55,879 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 17:53:55,879 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:55,880 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:53:55,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:53:55,980 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 17:53:55,981 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 17:53:55,985 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 17:53:55,987 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-07-11 17:53:55,987 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:55,987 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-07-11 17:53:55,987 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:53:55,987 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-07-11 17:53:55,987 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-07-11 17:53:55,987 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:55,988 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:55,989 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:55,989 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:53:55,989 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:53:55,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:53:55,989 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:55,989 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 17:53:55,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:55,989 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:55,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 17:53:55,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:55,990 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:55,990 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-07-11 17:53:55,990 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:55,990 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-07-11 17:53:55,990 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:53:55,990 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-07-11 17:53:55,990 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 17:53:55,990 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 17:53:55,991 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1689098029447.fcc1e02fb516934639a517c1444369be. 2023-07-11 17:53:55,991 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1689098029447.fcc1e02fb516934639a517c1444369be. started... 2023-07-11 17:53:55,991 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing fcc1e02fb516934639a517c1444369be 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-11 17:53:56,134 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-07-11 17:53:56,405 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512310f047638d9d54cf89ff4594919aa5e59 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512310f047638d9d54cf89ff4594919aa5e59 2023-07-11 17:53:56,811 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithWeeklyPolicy/fcc1e02fb516934639a517c1444369be/.tmp/family1/4315dc7edfd34f4bad6e40fd30b6d0ea 2023-07-11 17:53:56,816 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithWeeklyPolicy/fcc1e02fb516934639a517c1444369be/.tmp/family1/4315dc7edfd34f4bad6e40fd30b6d0ea as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithWeeklyPolicy/fcc1e02fb516934639a517c1444369be/family1/4315dc7edfd34f4bad6e40fd30b6d0ea 2023-07-11 17:53:56,821 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithWeeklyPolicy/fcc1e02fb516934639a517c1444369be/family1/4315dc7edfd34f4bad6e40fd30b6d0ea, entries=1, sequenceid=25, filesize=4.9 K 2023-07-11 17:53:56,822 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for fcc1e02fb516934639a517c1444369be in 831ms, sequenceid=25, compaction requested=true 2023-07-11 17:53:56,822 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for fcc1e02fb516934639a517c1444369be: 2023-07-11 17:53:56,822 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1689098029447.fcc1e02fb516934639a517c1444369be. 2023-07-11 17:53:56,822 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 17:53:56,822 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 17:53:56,822 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:56,822 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-07-11 17:53:56,822 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-07-11 17:53:56,824 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:56,825 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:56,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:56,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:53:56,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:53:56,825 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:56,825 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 17:53:56,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:53:56,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:53:56,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:56,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:56,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:53:56,826 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-07-11 17:53:56,826 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3dafd48[Count = 0] remaining members to acquire global barrier 2023-07-11 17:53:56,826 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-07-11 17:53:56,826 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:56,828 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:56,828 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:56,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:56,828 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-07-11 17:53:56,828 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:56,828 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 17:53:56,828 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-07-11 17:53:56,828 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase9.apache.org,45839,1689097999112' in zk 2023-07-11 17:53:56,829 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-07-11 17:53:56,829 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:56,829 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:53:56,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:56,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:53:56,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:53:56,829 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-07-11 17:53:56,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:53:56,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:53:56,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:56,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:56,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:53:56,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:56,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:56,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase9.apache.org,45839,1689097999112': 2023-07-11 17:53:56,831 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-07-11 17:53:56,831 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-07-11 17:53:56,831 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 17:53:56,832 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 17:53:56,832 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:56,832 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 17:53:56,842 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:56,842 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:56,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:56,843 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:56,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:56,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:53:56,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:53:56,843 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:53:56,843 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:53:56,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:53:56,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:53:56,843 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:56,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:56,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:56,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:53:56,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:56,844 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:56,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:56,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:53:56,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:56,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:56,846 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:56,846 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:53:56,846 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:56,846 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:53:56,846 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-07-11 17:53:56,846 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 17:53:56,846 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:56,846 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:53:56,846 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:53:56,846 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:56,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:53:56,847 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-07-11 17:53:56,847 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 17:53:56,847 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:56,847 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:56,847 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:53:56,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:53:56,847 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:56,947 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 17:53:56,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 17:53:56,952 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 17:53:56,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-07-11 17:53:56,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:56,954 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-07-11 17:53:56,954 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:53:56,954 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-07-11 17:53:56,954 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-07-11 17:53:56,955 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:56,955 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:56,956 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:56,956 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:53:56,956 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:53:56,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:53:56,956 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:56,956 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 17:53:56,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:56,957 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:56,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 17:53:56,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:56,957 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:56,957 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-07-11 17:53:56,957 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:56,957 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-07-11 17:53:56,957 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:53:56,958 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-07-11 17:53:56,958 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 17:53:56,958 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 17:53:56,958 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1689098029447.fcc1e02fb516934639a517c1444369be. 2023-07-11 17:53:56,958 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1689098029447.fcc1e02fb516934639a517c1444369be. started... 2023-07-11 17:53:56,958 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing fcc1e02fb516934639a517c1444369be 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-11 17:53:57,371 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601012bc9b1b018b149e2a37ac4b9cd3eab2d to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601012bc9b1b018b149e2a37ac4b9cd3eab2d 2023-07-11 17:53:57,777 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithWeeklyPolicy/fcc1e02fb516934639a517c1444369be/.tmp/family1/d779e14b5c8547cf991601fb8c9a566f 2023-07-11 17:53:57,783 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithWeeklyPolicy/fcc1e02fb516934639a517c1444369be/.tmp/family1/d779e14b5c8547cf991601fb8c9a566f as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithWeeklyPolicy/fcc1e02fb516934639a517c1444369be/family1/d779e14b5c8547cf991601fb8c9a566f 2023-07-11 17:53:57,788 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithWeeklyPolicy/fcc1e02fb516934639a517c1444369be/family1/d779e14b5c8547cf991601fb8c9a566f, entries=1, sequenceid=29, filesize=4.9 K 2023-07-11 17:53:57,789 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for fcc1e02fb516934639a517c1444369be in 831ms, sequenceid=29, compaction requested=true 2023-07-11 17:53:57,789 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for fcc1e02fb516934639a517c1444369be: 2023-07-11 17:53:57,789 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1689098029447.fcc1e02fb516934639a517c1444369be. 2023-07-11 17:53:57,789 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 17:53:57,789 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 17:53:57,789 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:57,789 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-07-11 17:53:57,789 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-07-11 17:53:57,791 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:57,791 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:57,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:57,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:53:57,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:53:57,791 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:57,791 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 17:53:57,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:53:57,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:53:57,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:57,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:57,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:53:57,792 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-07-11 17:53:57,792 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@45099610[Count = 0] remaining members to acquire global barrier 2023-07-11 17:53:57,792 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-07-11 17:53:57,792 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:57,794 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:57,794 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:57,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:57,795 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-07-11 17:53:57,795 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-07-11 17:53:57,795 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase9.apache.org,45839,1689097999112' in zk 2023-07-11 17:53:57,795 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:57,795 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 17:53:57,796 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:57,796 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-07-11 17:53:57,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:57,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:53:57,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:53:57,796 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:53:57,796 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-07-11 17:53:57,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:53:57,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:53:57,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:57,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:57,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:53:57,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:57,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:57,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase9.apache.org,45839,1689097999112': 2023-07-11 17:53:57,798 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-07-11 17:53:57,798 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-07-11 17:53:57,798 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 17:53:57,798 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 17:53:57,798 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:57,798 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 17:53:57,800 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:57,800 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:57,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:57,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:53:57,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:53:57,800 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:57,800 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:53:57,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:57,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:53:57,800 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:57,800 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:53:57,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:53:57,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:57,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:57,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:53:57,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:57,802 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:57,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:57,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:53:57,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:57,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:57,804 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:57,804 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:53:57,804 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:57,804 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:53:57,804 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-07-11 17:53:57,804 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 17:53:57,804 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:53:57,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:53:57,804 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-07-11 17:53:57,804 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:53:57,804 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:57,804 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-07-11 17:53:57,804 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:57,804 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 17:53:57,804 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:53:57,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:53:57,804 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:57,805 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:57,805 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:57,905 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 17:53:57,906 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 17:53:57,910 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 17:53:57,912 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-07-11 17:53:57,912 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:57,912 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-07-11 17:53:57,912 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:53:57,913 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-07-11 17:53:57,913 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-07-11 17:53:57,913 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:57,913 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:57,916 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:57,916 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:53:57,916 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:53:57,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:53:57,916 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:57,916 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 17:53:57,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:57,917 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:57,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 17:53:57,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:57,917 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:57,917 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-07-11 17:53:57,917 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:57,917 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-07-11 17:53:57,917 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:53:57,917 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-07-11 17:53:57,918 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 17:53:57,918 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 17:53:57,918 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1689098029447.fcc1e02fb516934639a517c1444369be. 2023-07-11 17:53:57,918 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1689098029447.fcc1e02fb516934639a517c1444369be. started... 2023-07-11 17:53:57,918 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing fcc1e02fb516934639a517c1444369be 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-11 17:53:58,332 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103143616d0c1144d538772d3e092c8af2e to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160103143616d0c1144d538772d3e092c8af2e 2023-07-11 17:53:58,738 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithWeeklyPolicy/fcc1e02fb516934639a517c1444369be/.tmp/family1/3f902c9edfbf43838ff7be615c5c833b 2023-07-11 17:53:58,743 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithWeeklyPolicy/fcc1e02fb516934639a517c1444369be/.tmp/family1/3f902c9edfbf43838ff7be615c5c833b as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithWeeklyPolicy/fcc1e02fb516934639a517c1444369be/family1/3f902c9edfbf43838ff7be615c5c833b 2023-07-11 17:53:58,748 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithWeeklyPolicy/fcc1e02fb516934639a517c1444369be/family1/3f902c9edfbf43838ff7be615c5c833b, entries=1, sequenceid=33, filesize=4.9 K 2023-07-11 17:53:58,749 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for fcc1e02fb516934639a517c1444369be in 831ms, sequenceid=33, compaction requested=true 2023-07-11 17:53:58,749 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for fcc1e02fb516934639a517c1444369be: 2023-07-11 17:53:58,749 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1689098029447.fcc1e02fb516934639a517c1444369be. 2023-07-11 17:53:58,749 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 17:53:58,749 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 17:53:58,749 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:58,749 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-07-11 17:53:58,749 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-07-11 17:53:58,751 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:58,751 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:58,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:58,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:53:58,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:53:58,751 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:58,751 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 17:53:58,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:53:58,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:53:58,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:58,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:58,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:53:58,753 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-07-11 17:53:58,753 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@73527dd[Count = 0] remaining members to acquire global barrier 2023-07-11 17:53:58,753 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-07-11 17:53:58,753 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:58,754 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:58,754 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:58,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:58,754 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-07-11 17:53:58,754 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-07-11 17:53:58,754 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase9.apache.org,45839,1689097999112' in zk 2023-07-11 17:53:58,754 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:58,754 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 17:53:58,755 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-07-11 17:53:58,755 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:58,755 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:53:58,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:58,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:53:58,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:53:58,755 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-07-11 17:53:58,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:53:58,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:53:58,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:58,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:58,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:53:58,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:58,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:58,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase9.apache.org,45839,1689097999112': 2023-07-11 17:53:58,758 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-07-11 17:53:58,758 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-07-11 17:53:58,758 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 17:53:58,758 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 17:53:58,758 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:58,758 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 17:53:58,761 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:58,761 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:58,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:58,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:53:58,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:53:58,761 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:58,761 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:53:58,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:58,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:53:58,761 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:58,761 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:53:58,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:53:58,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:58,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:58,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:53:58,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:58,762 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:58,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:58,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:53:58,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:58,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:58,764 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:58,764 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:53:58,764 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:58,764 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:53:58,764 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:58,765 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-07-11 17:53:58,765 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-07-11 17:53:58,764 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:53:58,765 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 17:53:58,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:53:58,765 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:58,765 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:53:58,765 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:58,765 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:58,765 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:58,765 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-07-11 17:53:58,765 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:53:58,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:53:58,765 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 17:53:58,865 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 17:53:58,866 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 17:53:58,871 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 17:53:58,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-07-11 17:53:58,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:58,873 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-07-11 17:53:58,873 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:53:58,873 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-07-11 17:53:58,873 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-07-11 17:53:58,873 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:58,873 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:58,874 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:58,874 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:53:58,874 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:53:58,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:53:58,875 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:58,875 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 17:53:58,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:58,875 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:58,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 17:53:58,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:58,876 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:58,876 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-07-11 17:53:58,876 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:58,876 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-07-11 17:53:58,876 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:53:58,876 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-07-11 17:53:58,876 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 17:53:58,876 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 17:53:58,876 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1689098029447.fcc1e02fb516934639a517c1444369be. 2023-07-11 17:53:58,876 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1689098029447.fcc1e02fb516934639a517c1444369be. started... 2023-07-11 17:53:58,877 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing fcc1e02fb516934639a517c1444369be 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-11 17:53:59,290 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907c6a7db8c74a54a55ba91379df196298a to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20150907c6a7db8c74a54a55ba91379df196298a 2023-07-11 17:53:59,696 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithWeeklyPolicy/fcc1e02fb516934639a517c1444369be/.tmp/family1/ce64bfca8ce646bb9d3faa9097d94947 2023-07-11 17:53:59,702 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithWeeklyPolicy/fcc1e02fb516934639a517c1444369be/.tmp/family1/ce64bfca8ce646bb9d3faa9097d94947 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithWeeklyPolicy/fcc1e02fb516934639a517c1444369be/family1/ce64bfca8ce646bb9d3faa9097d94947 2023-07-11 17:53:59,707 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithWeeklyPolicy/fcc1e02fb516934639a517c1444369be/family1/ce64bfca8ce646bb9d3faa9097d94947, entries=1, sequenceid=37, filesize=4.9 K 2023-07-11 17:53:59,708 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for fcc1e02fb516934639a517c1444369be in 832ms, sequenceid=37, compaction requested=true 2023-07-11 17:53:59,708 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for fcc1e02fb516934639a517c1444369be: 2023-07-11 17:53:59,709 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1689098029447.fcc1e02fb516934639a517c1444369be. 2023-07-11 17:53:59,709 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 17:53:59,709 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 17:53:59,709 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:59,709 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-07-11 17:53:59,709 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-07-11 17:53:59,710 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:59,710 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:59,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:59,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:53:59,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:53:59,711 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:59,711 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 17:53:59,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:53:59,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:53:59,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:59,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:59,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:53:59,712 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-07-11 17:53:59,712 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1eea777a[Count = 0] remaining members to acquire global barrier 2023-07-11 17:53:59,712 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-07-11 17:53:59,712 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:59,717 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:59,717 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:59,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:59,717 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-07-11 17:53:59,717 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-07-11 17:53:59,717 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase9.apache.org,45839,1689097999112' in zk 2023-07-11 17:53:59,717 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:59,717 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 17:53:59,718 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-07-11 17:53:59,718 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:59,718 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:53:59,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:59,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:53:59,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:53:59,718 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-07-11 17:53:59,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:53:59,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:53:59,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:59,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:59,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:53:59,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:59,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:59,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase9.apache.org,45839,1689097999112': 2023-07-11 17:53:59,721 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-07-11 17:53:59,721 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-07-11 17:53:59,721 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 17:53:59,721 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 17:53:59,721 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:59,721 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 17:53:59,722 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:59,722 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:59,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:59,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:53:59,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:53:59,722 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:59,722 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:53:59,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:59,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:53:59,723 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:53:59,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:53:59,723 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:59,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:59,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:59,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:53:59,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:59,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:59,724 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:59,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:53:59,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:59,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:59,726 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:59,726 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:59,726 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:53:59,726 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:53:59,726 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:59,726 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:53:59,726 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-07-11 17:53:59,726 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 17:53:59,726 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:53:59,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:53:59,726 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:59,727 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:59,727 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:59,727 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:59,727 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-07-11 17:53:59,727 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 17:53:59,727 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:53:59,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:53:59,827 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 17:53:59,828 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 17:53:59,850 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-11 17:53:59,850 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1b15da1a to 127.0.0.1:50702 2023-07-11 17:53:59,850 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 17:53:59,851 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-11 17:53:59,851 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5de972d1 to 127.0.0.1:50702 2023-07-11 17:53:59,851 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 17:53:59,852 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 17:53:59,852 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-11 17:53:59,852 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x243d5bfb to 127.0.0.1:50702 2023-07-11 17:53:59,852 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 17:53:59,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-07-11 17:53:59,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:59,855 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-07-11 17:53:59,855 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:53:59,855 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-07-11 17:53:59,855 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-07-11 17:53:59,955 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:59,956 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:59,957 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:53:59,957 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:59,957 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:53:59,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:53:59,957 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:53:59,957 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 17:53:59,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:59,958 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:59,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 17:53:59,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:59,958 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:59,958 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-07-11 17:53:59,959 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-07-11 17:53:59,959 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:53:59,959 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-07-11 17:53:59,959 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 17:53:59,959 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 17:53:59,959 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1689098029447.fcc1e02fb516934639a517c1444369be. 2023-07-11 17:53:59,959 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1689098029447.fcc1e02fb516934639a517c1444369be. started... 2023-07-11 17:53:59,959 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing fcc1e02fb516934639a517c1444369be 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-11 17:54:00,373 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120a25af91b56e9482ea58a258874dcc314 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151120a25af91b56e9482ea58a258874dcc314 2023-07-11 17:54:00,779 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithWeeklyPolicy/fcc1e02fb516934639a517c1444369be/.tmp/family1/52e413eef93c48fa96fdd1c483ec969f 2023-07-11 17:54:00,785 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithWeeklyPolicy/fcc1e02fb516934639a517c1444369be/.tmp/family1/52e413eef93c48fa96fdd1c483ec969f as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithWeeklyPolicy/fcc1e02fb516934639a517c1444369be/family1/52e413eef93c48fa96fdd1c483ec969f 2023-07-11 17:54:00,790 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithWeeklyPolicy/fcc1e02fb516934639a517c1444369be/family1/52e413eef93c48fa96fdd1c483ec969f, entries=1, sequenceid=41, filesize=4.9 K 2023-07-11 17:54:00,791 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for fcc1e02fb516934639a517c1444369be in 832ms, sequenceid=41, compaction requested=true 2023-07-11 17:54:00,791 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for fcc1e02fb516934639a517c1444369be: 2023-07-11 17:54:00,791 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1689098029447.fcc1e02fb516934639a517c1444369be. 2023-07-11 17:54:00,792 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 17:54:00,792 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 17:54:00,792 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:00,792 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-07-11 17:54:00,792 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-07-11 17:54:00,793 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:00,793 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:54:00,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:00,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:54:00,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:54:00,793 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:54:00,794 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 17:54:00,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:54:00,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:54:00,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-11 17:54:00,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:00,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:54:00,795 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-07-11 17:54:00,795 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4a0ee952[Count = 0] remaining members to acquire global barrier 2023-07-11 17:54:00,795 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-07-11 17:54:00,795 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:54:00,797 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:54:00,797 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:54:00,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:54:00,797 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-07-11 17:54:00,797 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-07-11 17:54:00,797 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase9.apache.org,45839,1689097999112' in zk 2023-07-11 17:54:00,797 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:00,797 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 17:54:00,799 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-07-11 17:54:00,799 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:00,799 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:54:00,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:00,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:54:00,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:54:00,799 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-07-11 17:54:00,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:54:00,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:54:00,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-11 17:54:00,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:00,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:54:00,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-11 17:54:00,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:00,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase9.apache.org,45839,1689097999112': 2023-07-11 17:54:00,801 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-07-11 17:54:00,801 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-07-11 17:54:00,801 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 17:54:00,801 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 17:54:00,802 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-07-11 17:54:00,802 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 17:54:00,803 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:54:00,803 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:54:00,803 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:54:00,803 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:54:00,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:54:00,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:54:00,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:54:00,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:54:00,804 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:54:00,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:54:00,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:54:00,804 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:00,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:54:00,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-11 17:54:00,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:54:00,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-11 17:54:00,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:00,805 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:00,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:54:00,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-07-11 17:54:00,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:00,807 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:00,807 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:54:00,808 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:54:00,808 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:54:00,808 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:54:00,808 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-07-11 17:54:00,808 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 17:54:00,808 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:54:00,808 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:54:00,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:54:00,808 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:00,808 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-07-11 17:54:00,808 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:54:00,808 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 17:54:00,808 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:54:00,808 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:54:00,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:54:00,809 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-07-11 17:54:00,909 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 17:54:00,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 17:54:00,911 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=36885] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMinorCompactionWithWeeklyPolicy 2023-07-11 17:54:00,913 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-07-11 17:54:00,914 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=26, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-07-11 17:54:00,915 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] mob.MobUtils(833): start MOB compaction of files for table='testMinorCompactionWithWeeklyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-07-11 17:54:00,915 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=26, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1689098640915 2023-07-11 17:54:00,917 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-07-11 17:54:00,918 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] compactions.PartitionedMobCompactor(306): The compaction type is PART_FILES, the request has 0 del files, 9 selected files, and 0 irrelevant files table 'testMinorCompactionWithWeeklyPolicy' and column 'family1' 2023-07-11 17:54:00,918 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-07-11 17:54:00,919 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] zookeeper.ReadOnlyZKClient(139): Connect 0x7b26b505 to 127.0.0.1:50702 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 17:54:00,926 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6778d58b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 17:54:00,926 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-07-11 17:54:01,777 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601032250325458a140ee8399decbd9104f2d to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601032250325458a140ee8399decbd9104f2d 2023-07-11 17:54:01,778 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-07-11 17:54:01,793 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 17:54:01,794 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:58978, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 17:54:01,801 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-11 17:54:01,803 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:58400, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-11 17:54:01,812 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/46baacc3e4ef460cb31c4bb0b4fb5d14 first=Optional[r3] last=Optional[r6] 2023-07-11 17:54:01,812 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithWeeklyPolicy,,1689098029447.fcc1e02fb516934639a517c1444369be., hostname=jenkins-hbase9.apache.org,45839,1689097999112, seqNum=2 for row with hfile group [{family1,hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/46baacc3e4ef460cb31c4bb0b4fb5d14}] 2023-07-11 17:54:01,817 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(763): Validating hfile at hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/46baacc3e4ef460cb31c4bb0b4fb5d14 for inclusion in fcc1e02fb516934639a517c1444369be/family1 2023-07-11 17:54:01,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-07-11 17:54:01,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(777): Region bounds: first= last= 2023-07-11 17:54:01,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HRegion(2446): Flush status journal for fcc1e02fb516934639a517c1444369be: 2023-07-11 17:54:01,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/46baacc3e4ef460cb31c4bb0b4fb5d14 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testMinorCompactionWithWeeklyPolicy__g7srf50bs5kg1snolhcl1ftmdquo2t68t30a3hb0cvs092o4396f5kkhvegufdrp/family1/46baacc3e4ef460cb31c4bb0b4fb5d14 2023-07-11 17:54:01,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testMinorCompactionWithWeeklyPolicy__g7srf50bs5kg1snolhcl1ftmdquo2t68t30a3hb0cvs092o4396f5kkhvegufdrp/family1/46baacc3e4ef460cb31c4bb0b4fb5d14 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithWeeklyPolicy/fcc1e02fb516934639a517c1444369be/family1/6e51591f5b8c4f85b3bc93986da56b57_SeqId_44_ 2023-07-11 17:54:01,824 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(849): Loaded HFile hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testMinorCompactionWithWeeklyPolicy__g7srf50bs5kg1snolhcl1ftmdquo2t68t30a3hb0cvs092o4396f5kkhvegufdrp/family1/46baacc3e4ef460cb31c4bb0b4fb5d14 into fcc1e02fb516934639a517c1444369be/family1 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithWeeklyPolicy/fcc1e02fb516934639a517c1444369be/family1/6e51591f5b8c4f85b3bc93986da56b57_SeqId_44_ - updating store file list. 2023-07-11 17:54:01,829 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(882): Loaded HFile hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithWeeklyPolicy/fcc1e02fb516934639a517c1444369be/family1/6e51591f5b8c4f85b3bc93986da56b57_SeqId_44_ into fcc1e02fb516934639a517c1444369be/family1 2023-07-11 17:54:01,829 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(855): Successfully loaded hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testMinorCompactionWithWeeklyPolicy__g7srf50bs5kg1snolhcl1ftmdquo2t68t30a3hb0cvs092o4396f5kkhvegufdrp/family1/46baacc3e4ef460cb31c4bb0b4fb5d14 into fcc1e02fb516934639a517c1444369be/family1 (new location: hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithWeeklyPolicy/fcc1e02fb516934639a517c1444369be/family1/6e51591f5b8c4f85b3bc93986da56b57_SeqId_44_) 2023-07-11 17:54:01,833 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testMinorCompactionWithWeeklyPolicy__g7srf50bs5kg1snolhcl1ftmdquo2t68t30a3hb0cvs092o4396f5kkhvegufdrp/family1/46baacc3e4ef460cb31c4bb0b4fb5d14 2023-07-11 17:54:01,834 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-07-11 17:54:01,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51214 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-07-11 17:54:01,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(1912): fcc1e02fb516934639a517c1444369be/family1 is initiating minor compaction 2023-07-11 17:54:01,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@481b65aa; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-11 17:54:01,837 INFO [RS:0;jenkins-hbase9:45839-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of fcc1e02fb516934639a517c1444369be/family1 in testMinorCompactionWithWeeklyPolicy,,1689098029447.fcc1e02fb516934639a517c1444369be. 2023-07-11 17:54:01,838 INFO [RS:0;jenkins-hbase9:45839-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithWeeklyPolicy/fcc1e02fb516934639a517c1444369be/family1/131c3866ae92404ba053928539ef1f0a, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithWeeklyPolicy/fcc1e02fb516934639a517c1444369be/family1/eb49c6ddce3c4bd9989d27c2fa481ebb, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithWeeklyPolicy/fcc1e02fb516934639a517c1444369be/family1/b4a244b4ed7b4b0baf639c5afd5a19ce, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithWeeklyPolicy/fcc1e02fb516934639a517c1444369be/family1/9cb8e805448d4e14a303fb14d6a74749, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithWeeklyPolicy/fcc1e02fb516934639a517c1444369be/family1/4315dc7edfd34f4bad6e40fd30b6d0ea, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithWeeklyPolicy/fcc1e02fb516934639a517c1444369be/family1/d779e14b5c8547cf991601fb8c9a566f, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithWeeklyPolicy/fcc1e02fb516934639a517c1444369be/family1/3f902c9edfbf43838ff7be615c5c833b, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithWeeklyPolicy/fcc1e02fb516934639a517c1444369be/family1/ce64bfca8ce646bb9d3faa9097d94947, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithWeeklyPolicy/fcc1e02fb516934639a517c1444369be/family1/52e413eef93c48fa96fdd1c483ec969f, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithWeeklyPolicy/fcc1e02fb516934639a517c1444369be/family1/6e51591f5b8c4f85b3bc93986da56b57_SeqId_44_] into tmpdir=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithWeeklyPolicy/fcc1e02fb516934639a517c1444369be/.tmp, totalSize=50.0 K 2023-07-11 17:54:01,838 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] compactions.Compactor(207): Compacting 131c3866ae92404ba053928539ef1f0a, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-07-11 17:54:01,838 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] compactions.Compactor(207): Compacting eb49c6ddce3c4bd9989d27c2fa481ebb, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-07-11 17:54:01,838 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] compactions.Compactor(207): Compacting b4a244b4ed7b4b0baf639c5afd5a19ce, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-07-11 17:54:01,838 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] compactions.Compactor(207): Compacting 9cb8e805448d4e14a303fb14d6a74749, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-07-11 17:54:01,838 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] compactions.Compactor(207): Compacting 4315dc7edfd34f4bad6e40fd30b6d0ea, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-07-11 17:54:01,838 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] compactions.Compactor(207): Compacting d779e14b5c8547cf991601fb8c9a566f, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-07-11 17:54:01,838 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] compactions.Compactor(207): Compacting 3f902c9edfbf43838ff7be615c5c833b, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-07-11 17:54:01,838 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] compactions.Compactor(207): Compacting ce64bfca8ce646bb9d3faa9097d94947, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-07-11 17:54:01,838 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] compactions.Compactor(207): Compacting 52e413eef93c48fa96fdd1c483ec969f, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-07-11 17:54:01,838 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] compactions.Compactor(207): Compacting 6e51591f5b8c4f85b3bc93986da56b57_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-07-11 17:54:01,839 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-07-11 17:54:01,840 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 17:54:01,842 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512283ef4204f9e7c40d0a096af6afa75d51a to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512283ef4204f9e7c40d0a096af6afa75d51a 2023-07-11 17:54:01,843 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512310f047638d9d54cf89ff4594919aa5e59 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512310f047638d9d54cf89ff4594919aa5e59 2023-07-11 17:54:01,845 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601012bc9b1b018b149e2a37ac4b9cd3eab2d to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601012bc9b1b018b149e2a37ac4b9cd3eab2d 2023-07-11 17:54:01,846 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160103143616d0c1144d538772d3e092c8af2e to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160103143616d0c1144d538772d3e092c8af2e 2023-07-11 17:54:01,846 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithWeeklyPolicy 4 expired mob files are deleted 2023-07-11 17:54:01,846 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-07-11 17:54:01,847 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-07-11 17:54:01,847 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-07-11 17:54:01,847 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-07-11 17:54:01,847 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-07-11 17:54:01,847 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-07-11 17:54:01,847 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-07-11 17:54:01,847 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-07-11 17:54:01,847 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-07-11 17:54:01,869 INFO [RS:0;jenkins-hbase9:45839-shortCompactions-0] throttle.PressureAwareThroughputController(145): fcc1e02fb516934639a517c1444369be#family1#compaction#34 average throughput is 0.68 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-11 17:54:02,281 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205e0a7682cacfd48589ba9a2e5391e6fbb to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151205e0a7682cacfd48589ba9a2e5391e6fbb 2023-07-11 17:54:02,282 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-07-11 17:54:02,306 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/e5cadc8fdfae4743bb646edb0b2c2774 first=Optional[r1] last=Optional[r2] 2023-07-11 17:54:02,307 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithWeeklyPolicy,,1689098029447.fcc1e02fb516934639a517c1444369be., hostname=jenkins-hbase9.apache.org,45839,1689097999112, seqNum=2 for row with hfile group [{family1,hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/e5cadc8fdfae4743bb646edb0b2c2774}] 2023-07-11 17:54:02,310 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(763): Validating hfile at hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/e5cadc8fdfae4743bb646edb0b2c2774 for inclusion in fcc1e02fb516934639a517c1444369be/family1 2023-07-11 17:54:02,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(775): HFile bounds: first=r1 last=r2 2023-07-11 17:54:02,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(777): Region bounds: first= last= 2023-07-11 17:54:02,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HRegion(2446): Flush status journal for fcc1e02fb516934639a517c1444369be: 2023-07-11 17:54:02,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/e5cadc8fdfae4743bb646edb0b2c2774 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testMinorCompactionWithWeeklyPolicy__tbus4ko5gqqre1ka6921ipgotihs3qmuodo7equmcugc0if2t4i7i7u9gq999bfg/family1/e5cadc8fdfae4743bb646edb0b2c2774 2023-07-11 17:54:02,316 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testMinorCompactionWithWeeklyPolicy__tbus4ko5gqqre1ka6921ipgotihs3qmuodo7equmcugc0if2t4i7i7u9gq999bfg/family1/e5cadc8fdfae4743bb646edb0b2c2774 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithWeeklyPolicy/fcc1e02fb516934639a517c1444369be/family1/d42521724d424705b7073577dd0ca5f2_SeqId_46_ 2023-07-11 17:54:02,317 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(849): Loaded HFile hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testMinorCompactionWithWeeklyPolicy__tbus4ko5gqqre1ka6921ipgotihs3qmuodo7equmcugc0if2t4i7i7u9gq999bfg/family1/e5cadc8fdfae4743bb646edb0b2c2774 into fcc1e02fb516934639a517c1444369be/family1 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithWeeklyPolicy/fcc1e02fb516934639a517c1444369be/family1/d42521724d424705b7073577dd0ca5f2_SeqId_46_ - updating store file list. 2023-07-11 17:54:02,321 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(882): Loaded HFile hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithWeeklyPolicy/fcc1e02fb516934639a517c1444369be/family1/d42521724d424705b7073577dd0ca5f2_SeqId_46_ into fcc1e02fb516934639a517c1444369be/family1 2023-07-11 17:54:02,321 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(855): Successfully loaded hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testMinorCompactionWithWeeklyPolicy__tbus4ko5gqqre1ka6921ipgotihs3qmuodo7equmcugc0if2t4i7i7u9gq999bfg/family1/e5cadc8fdfae4743bb646edb0b2c2774 into fcc1e02fb516934639a517c1444369be/family1 (new location: hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithWeeklyPolicy/fcc1e02fb516934639a517c1444369be/family1/d42521724d424705b7073577dd0ca5f2_SeqId_46_) 2023-07-11 17:54:02,321 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testMinorCompactionWithWeeklyPolicy__tbus4ko5gqqre1ka6921ipgotihs3qmuodo7equmcugc0if2t4i7i7u9gq999bfg/family1/e5cadc8fdfae4743bb646edb0b2c2774 2023-07-11 17:54:02,323 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-07-11 17:54:02,324 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 17:54:02,325 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151201813bc7282fd243b7b131a8050a8c434d to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151201813bc7282fd243b7b131a8050a8c434d 2023-07-11 17:54:02,326 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151205a345d834f9b6487ea13747af9fdd0a64 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151205a345d834f9b6487ea13747af9fdd0a64 2023-07-11 17:54:02,326 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithWeeklyPolicy 2 expired mob files are deleted 2023-07-11 17:54:02,326 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-07-11 17:54:02,327 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-07-11 17:54:02,327 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-07-11 17:54:02,327 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] mob.MobUtils(840): end MOB compaction of files for table='testMinorCompactionWithWeeklyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-07-11 17:54:02,328 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=26, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-07-11 17:54:02,329 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE in 1.4160 sec 2023-07-11 17:54:02,439 INFO [Listener at localhost/43271] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompactionWithWeeklyPolicy Thread=248 (was 262), OpenFileDescriptor=592 (was 617), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=164 (was 211), ProcessCount=170 (was 170), AvailableMemoryMB=8667 (was 8850) 2023-07-11 17:54:02,450 INFO [Listener at localhost/43271] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testScannerOnBulkLoadRefHFiles Thread=248, OpenFileDescriptor=592, MaxFileDescriptor=60000, SystemLoadAverage=164, ProcessCount=170, AvailableMemoryMB=8666 2023-07-11 17:54:02,452 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-11 17:54:02,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles 2023-07-11 17:54:02,455 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_PRE_OPERATION 2023-07-11 17:54:02,455 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testScannerOnBulkLoadRefHFiles" procId is: 27 2023-07-11 17:54:02,456 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-11 17:54:02,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-11 17:54:02,458 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/.tmp/data/default/testScannerOnBulkLoadRefHFiles/55b22085c6b006e3a631c2a366691bf8 2023-07-11 17:54:02,458 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/.tmp/data/default/testScannerOnBulkLoadRefHFiles/64a1f72c6487e7f4ae550729b9dbcb83 2023-07-11 17:54:02,458 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/.tmp/data/default/testScannerOnBulkLoadRefHFiles/47ee8c355f31465b357785487e314b0f 2023-07-11 17:54:02,459 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/.tmp/data/default/testScannerOnBulkLoadRefHFiles/55b22085c6b006e3a631c2a366691bf8 empty. 2023-07-11 17:54:02,459 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/.tmp/data/default/testScannerOnBulkLoadRefHFiles/64a1f72c6487e7f4ae550729b9dbcb83 empty. 2023-07-11 17:54:02,459 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/.tmp/data/default/testScannerOnBulkLoadRefHFiles/47ee8c355f31465b357785487e314b0f empty. 2023-07-11 17:54:02,459 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/.tmp/data/default/testScannerOnBulkLoadRefHFiles/55b22085c6b006e3a631c2a366691bf8 2023-07-11 17:54:02,459 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/.tmp/data/default/testScannerOnBulkLoadRefHFiles/64a1f72c6487e7f4ae550729b9dbcb83 2023-07-11 17:54:02,459 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/.tmp/data/default/testScannerOnBulkLoadRefHFiles/47ee8c355f31465b357785487e314b0f 2023-07-11 17:54:02,459 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testScannerOnBulkLoadRefHFiles regions 2023-07-11 17:54:02,557 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-11 17:54:02,685 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithWeeklyPolicy/fcc1e02fb516934639a517c1444369be/.tmp/family1/121afb835ba144a2870afd1e897714f5 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithWeeklyPolicy/fcc1e02fb516934639a517c1444369be/family1/121afb835ba144a2870afd1e897714f5 2023-07-11 17:54:02,690 INFO [RS:0;jenkins-hbase9:45839-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in fcc1e02fb516934639a517c1444369be/family1 of fcc1e02fb516934639a517c1444369be into 121afb835ba144a2870afd1e897714f5(size=6.6 K), total size for store is 176.8 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-11 17:54:02,691 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for fcc1e02fb516934639a517c1444369be: 2023-07-11 17:54:02,691 INFO [RS:0;jenkins-hbase9:45839-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithWeeklyPolicy,,1689098029447.fcc1e02fb516934639a517c1444369be., storeName=family1, fileCount=10, fileSize=50.0 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.5 K), priority=2, time=1689098041837; duration=0sec 2023-07-11 17:54:02,691 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-11 17:54:02,747 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithWeeklyPolicy/fcc1e02fb516934639a517c1444369be/family1/131c3866ae92404ba053928539ef1f0a, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithWeeklyPolicy/fcc1e02fb516934639a517c1444369be/family1/eb49c6ddce3c4bd9989d27c2fa481ebb, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithWeeklyPolicy/fcc1e02fb516934639a517c1444369be/family1/b4a244b4ed7b4b0baf639c5afd5a19ce, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithWeeklyPolicy/fcc1e02fb516934639a517c1444369be/family1/9cb8e805448d4e14a303fb14d6a74749, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithWeeklyPolicy/fcc1e02fb516934639a517c1444369be/family1/4315dc7edfd34f4bad6e40fd30b6d0ea, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithWeeklyPolicy/fcc1e02fb516934639a517c1444369be/family1/d779e14b5c8547cf991601fb8c9a566f, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithWeeklyPolicy/fcc1e02fb516934639a517c1444369be/family1/3f902c9edfbf43838ff7be615c5c833b, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithWeeklyPolicy/fcc1e02fb516934639a517c1444369be/family1/ce64bfca8ce646bb9d3faa9097d94947, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithWeeklyPolicy/fcc1e02fb516934639a517c1444369be/family1/52e413eef93c48fa96fdd1c483ec969f, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithWeeklyPolicy/fcc1e02fb516934639a517c1444369be/family1/6e51591f5b8c4f85b3bc93986da56b57_SeqId_44_] to archive 2023-07-11 17:54:02,748 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 17:54:02,751 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithWeeklyPolicy/fcc1e02fb516934639a517c1444369be/family1/131c3866ae92404ba053928539ef1f0a to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMinorCompactionWithWeeklyPolicy/fcc1e02fb516934639a517c1444369be/family1/131c3866ae92404ba053928539ef1f0a 2023-07-11 17:54:02,753 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithWeeklyPolicy/fcc1e02fb516934639a517c1444369be/family1/eb49c6ddce3c4bd9989d27c2fa481ebb to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMinorCompactionWithWeeklyPolicy/fcc1e02fb516934639a517c1444369be/family1/eb49c6ddce3c4bd9989d27c2fa481ebb 2023-07-11 17:54:02,754 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithWeeklyPolicy/fcc1e02fb516934639a517c1444369be/family1/b4a244b4ed7b4b0baf639c5afd5a19ce to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMinorCompactionWithWeeklyPolicy/fcc1e02fb516934639a517c1444369be/family1/b4a244b4ed7b4b0baf639c5afd5a19ce 2023-07-11 17:54:02,756 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithWeeklyPolicy/fcc1e02fb516934639a517c1444369be/family1/9cb8e805448d4e14a303fb14d6a74749 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMinorCompactionWithWeeklyPolicy/fcc1e02fb516934639a517c1444369be/family1/9cb8e805448d4e14a303fb14d6a74749 2023-07-11 17:54:02,757 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithWeeklyPolicy/fcc1e02fb516934639a517c1444369be/family1/4315dc7edfd34f4bad6e40fd30b6d0ea to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMinorCompactionWithWeeklyPolicy/fcc1e02fb516934639a517c1444369be/family1/4315dc7edfd34f4bad6e40fd30b6d0ea 2023-07-11 17:54:02,758 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-11 17:54:02,758 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithWeeklyPolicy/fcc1e02fb516934639a517c1444369be/family1/d779e14b5c8547cf991601fb8c9a566f to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMinorCompactionWithWeeklyPolicy/fcc1e02fb516934639a517c1444369be/family1/d779e14b5c8547cf991601fb8c9a566f 2023-07-11 17:54:02,760 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithWeeklyPolicy/fcc1e02fb516934639a517c1444369be/family1/3f902c9edfbf43838ff7be615c5c833b to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMinorCompactionWithWeeklyPolicy/fcc1e02fb516934639a517c1444369be/family1/3f902c9edfbf43838ff7be615c5c833b 2023-07-11 17:54:02,761 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithWeeklyPolicy/fcc1e02fb516934639a517c1444369be/family1/ce64bfca8ce646bb9d3faa9097d94947 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMinorCompactionWithWeeklyPolicy/fcc1e02fb516934639a517c1444369be/family1/ce64bfca8ce646bb9d3faa9097d94947 2023-07-11 17:54:02,762 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithWeeklyPolicy/fcc1e02fb516934639a517c1444369be/family1/52e413eef93c48fa96fdd1c483ec969f to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMinorCompactionWithWeeklyPolicy/fcc1e02fb516934639a517c1444369be/family1/52e413eef93c48fa96fdd1c483ec969f 2023-07-11 17:54:02,764 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithWeeklyPolicy/fcc1e02fb516934639a517c1444369be/family1/6e51591f5b8c4f85b3bc93986da56b57_SeqId_44_ to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMinorCompactionWithWeeklyPolicy/fcc1e02fb516934639a517c1444369be/family1/6e51591f5b8c4f85b3bc93986da56b57_SeqId_44_ 2023-07-11 17:54:02,867 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/.tmp/data/default/testScannerOnBulkLoadRefHFiles/.tabledesc/.tableinfo.0000000001 2023-07-11 17:54:02,869 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(7675): creating {ENCODED => 47ee8c355f31465b357785487e314b0f, NAME => 'testScannerOnBulkLoadRefHFiles,2,1689098042452.47ee8c355f31465b357785487e314b0f.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/.tmp 2023-07-11 17:54:02,869 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(7675): creating {ENCODED => 64a1f72c6487e7f4ae550729b9dbcb83, NAME => 'testScannerOnBulkLoadRefHFiles,1,1689098042452.64a1f72c6487e7f4ae550729b9dbcb83.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/.tmp 2023-07-11 17:54:02,869 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(7675): creating {ENCODED => 55b22085c6b006e3a631c2a366691bf8, NAME => 'testScannerOnBulkLoadRefHFiles,,1689098042452.55b22085c6b006e3a631c2a366691bf8.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/.tmp 2023-07-11 17:54:03,059 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-11 17:54:03,285 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,1,1689098042452.64a1f72c6487e7f4ae550729b9dbcb83.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 17:54:03,286 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1604): Closing 64a1f72c6487e7f4ae550729b9dbcb83, disabling compactions & flushes 2023-07-11 17:54:03,286 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,1,1689098042452.64a1f72c6487e7f4ae550729b9dbcb83. 2023-07-11 17:54:03,286 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,2,1689098042452.47ee8c355f31465b357785487e314b0f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 17:54:03,286 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,1,1689098042452.64a1f72c6487e7f4ae550729b9dbcb83. 2023-07-11 17:54:03,286 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1604): Closing 47ee8c355f31465b357785487e314b0f, disabling compactions & flushes 2023-07-11 17:54:03,286 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,1,1689098042452.64a1f72c6487e7f4ae550729b9dbcb83. after waiting 0 ms 2023-07-11 17:54:03,286 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,2,1689098042452.47ee8c355f31465b357785487e314b0f. 2023-07-11 17:54:03,286 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,2,1689098042452.47ee8c355f31465b357785487e314b0f. 2023-07-11 17:54:03,286 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,1,1689098042452.64a1f72c6487e7f4ae550729b9dbcb83. 2023-07-11 17:54:03,286 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,2,1689098042452.47ee8c355f31465b357785487e314b0f. after waiting 0 ms 2023-07-11 17:54:03,286 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,2,1689098042452.47ee8c355f31465b357785487e314b0f. 2023-07-11 17:54:03,286 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,1,1689098042452.64a1f72c6487e7f4ae550729b9dbcb83. 2023-07-11 17:54:03,286 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,2,1689098042452.47ee8c355f31465b357785487e314b0f. 2023-07-11 17:54:03,286 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1558): Region close journal for 47ee8c355f31465b357785487e314b0f: 2023-07-11 17:54:03,286 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1558): Region close journal for 64a1f72c6487e7f4ae550729b9dbcb83: 2023-07-11 17:54:03,287 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,,1689098042452.55b22085c6b006e3a631c2a366691bf8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 17:54:03,287 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1604): Closing 55b22085c6b006e3a631c2a366691bf8, disabling compactions & flushes 2023-07-11 17:54:03,287 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,,1689098042452.55b22085c6b006e3a631c2a366691bf8. 2023-07-11 17:54:03,287 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,,1689098042452.55b22085c6b006e3a631c2a366691bf8. 2023-07-11 17:54:03,287 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,,1689098042452.55b22085c6b006e3a631c2a366691bf8. after waiting 0 ms 2023-07-11 17:54:03,287 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,,1689098042452.55b22085c6b006e3a631c2a366691bf8. 2023-07-11 17:54:03,287 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,,1689098042452.55b22085c6b006e3a631c2a366691bf8. 2023-07-11 17:54:03,287 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1558): Region close journal for 55b22085c6b006e3a631c2a366691bf8: 2023-07-11 17:54:03,289 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_ADD_TO_META 2023-07-11 17:54:03,290 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,2,1689098042452.47ee8c355f31465b357785487e314b0f.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1689098043290"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689098043290"}]},"ts":"1689098043290"} 2023-07-11 17:54:03,290 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,1,1689098042452.64a1f72c6487e7f4ae550729b9dbcb83.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689098043290"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689098043290"}]},"ts":"1689098043290"} 2023-07-11 17:54:03,290 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,,1689098042452.55b22085c6b006e3a631c2a366691bf8.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1689098043290"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689098043290"}]},"ts":"1689098043290"} 2023-07-11 17:54:03,293 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-07-11 17:54:03,294 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-11 17:54:03,294 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testScannerOnBulkLoadRefHFiles","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689098043294"}]},"ts":"1689098043294"} 2023-07-11 17:54:03,295 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testScannerOnBulkLoadRefHFiles, state=ENABLING in hbase:meta 2023-07-11 17:54:03,298 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=55b22085c6b006e3a631c2a366691bf8, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=64a1f72c6487e7f4ae550729b9dbcb83, ASSIGN}, {pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=47ee8c355f31465b357785487e314b0f, ASSIGN}] 2023-07-11 17:54:03,300 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=64a1f72c6487e7f4ae550729b9dbcb83, ASSIGN 2023-07-11 17:54:03,300 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=55b22085c6b006e3a631c2a366691bf8, ASSIGN 2023-07-11 17:54:03,300 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=47ee8c355f31465b357785487e314b0f, ASSIGN 2023-07-11 17:54:03,301 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=64a1f72c6487e7f4ae550729b9dbcb83, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,45839,1689097999112; forceNewPlan=false, retain=false 2023-07-11 17:54:03,301 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=55b22085c6b006e3a631c2a366691bf8, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,45839,1689097999112; forceNewPlan=false, retain=false 2023-07-11 17:54:03,301 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=47ee8c355f31465b357785487e314b0f, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,45839,1689097999112; forceNewPlan=false, retain=false 2023-07-11 17:54:03,452 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=47ee8c355f31465b357785487e314b0f, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:03,452 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=64a1f72c6487e7f4ae550729b9dbcb83, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:03,452 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,2,1689098042452.47ee8c355f31465b357785487e314b0f.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1689098043452"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689098043452"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689098043452"}]},"ts":"1689098043452"} 2023-07-11 17:54:03,452 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=55b22085c6b006e3a631c2a366691bf8, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:03,453 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,1,1689098042452.64a1f72c6487e7f4ae550729b9dbcb83.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689098043452"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689098043452"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689098043452"}]},"ts":"1689098043452"} 2023-07-11 17:54:03,453 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,,1689098042452.55b22085c6b006e3a631c2a366691bf8.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1689098043452"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689098043452"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689098043452"}]},"ts":"1689098043452"} 2023-07-11 17:54:03,454 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=30, state=RUNNABLE; OpenRegionProcedure 47ee8c355f31465b357785487e314b0f, server=jenkins-hbase9.apache.org,45839,1689097999112}] 2023-07-11 17:54:03,455 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=32, ppid=29, state=RUNNABLE; OpenRegionProcedure 64a1f72c6487e7f4ae550729b9dbcb83, server=jenkins-hbase9.apache.org,45839,1689097999112}] 2023-07-11 17:54:03,456 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=33, ppid=28, state=RUNNABLE; OpenRegionProcedure 55b22085c6b006e3a631c2a366691bf8, server=jenkins-hbase9.apache.org,45839,1689097999112}] 2023-07-11 17:54:03,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-11 17:54:03,609 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testScannerOnBulkLoadRefHFiles,1,1689098042452.64a1f72c6487e7f4ae550729b9dbcb83. 2023-07-11 17:54:03,609 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 64a1f72c6487e7f4ae550729b9dbcb83, NAME => 'testScannerOnBulkLoadRefHFiles,1,1689098042452.64a1f72c6487e7f4ae550729b9dbcb83.', STARTKEY => '1', ENDKEY => '2'} 2023-07-11 17:54:03,610 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles 64a1f72c6487e7f4ae550729b9dbcb83 2023-07-11 17:54:03,610 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,1,1689098042452.64a1f72c6487e7f4ae550729b9dbcb83.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 17:54:03,610 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 64a1f72c6487e7f4ae550729b9dbcb83 2023-07-11 17:54:03,610 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 64a1f72c6487e7f4ae550729b9dbcb83 2023-07-11 17:54:03,611 INFO [StoreOpener-64a1f72c6487e7f4ae550729b9dbcb83-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 64a1f72c6487e7f4ae550729b9dbcb83 2023-07-11 17:54:03,612 DEBUG [StoreOpener-64a1f72c6487e7f4ae550729b9dbcb83-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testScannerOnBulkLoadRefHFiles/64a1f72c6487e7f4ae550729b9dbcb83/family1 2023-07-11 17:54:03,612 DEBUG [StoreOpener-64a1f72c6487e7f4ae550729b9dbcb83-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testScannerOnBulkLoadRefHFiles/64a1f72c6487e7f4ae550729b9dbcb83/family1 2023-07-11 17:54:03,613 INFO [StoreOpener-64a1f72c6487e7f4ae550729b9dbcb83-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 64a1f72c6487e7f4ae550729b9dbcb83 columnFamilyName family1 2023-07-11 17:54:03,614 INFO [StoreOpener-64a1f72c6487e7f4ae550729b9dbcb83-1] regionserver.HStore(310): Store=64a1f72c6487e7f4ae550729b9dbcb83/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 17:54:03,614 INFO [StoreOpener-64a1f72c6487e7f4ae550729b9dbcb83-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 64a1f72c6487e7f4ae550729b9dbcb83 2023-07-11 17:54:03,615 DEBUG [StoreOpener-64a1f72c6487e7f4ae550729b9dbcb83-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testScannerOnBulkLoadRefHFiles/64a1f72c6487e7f4ae550729b9dbcb83/family2 2023-07-11 17:54:03,615 DEBUG [StoreOpener-64a1f72c6487e7f4ae550729b9dbcb83-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testScannerOnBulkLoadRefHFiles/64a1f72c6487e7f4ae550729b9dbcb83/family2 2023-07-11 17:54:03,616 INFO [StoreOpener-64a1f72c6487e7f4ae550729b9dbcb83-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 64a1f72c6487e7f4ae550729b9dbcb83 columnFamilyName family2 2023-07-11 17:54:03,617 INFO [StoreOpener-64a1f72c6487e7f4ae550729b9dbcb83-1] regionserver.HStore(310): Store=64a1f72c6487e7f4ae550729b9dbcb83/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 17:54:03,618 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testScannerOnBulkLoadRefHFiles/64a1f72c6487e7f4ae550729b9dbcb83 2023-07-11 17:54:03,618 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testScannerOnBulkLoadRefHFiles/64a1f72c6487e7f4ae550729b9dbcb83 2023-07-11 17:54:03,619 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-07-11 17:54:03,620 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 64a1f72c6487e7f4ae550729b9dbcb83 2023-07-11 17:54:03,622 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testScannerOnBulkLoadRefHFiles/64a1f72c6487e7f4ae550729b9dbcb83/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 17:54:03,622 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 64a1f72c6487e7f4ae550729b9dbcb83; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63794499, jitterRate=-0.04938788712024689}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-07-11 17:54:03,622 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 64a1f72c6487e7f4ae550729b9dbcb83: 2023-07-11 17:54:03,623 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,1,1689098042452.64a1f72c6487e7f4ae550729b9dbcb83., pid=32, masterSystemTime=1689098043606 2023-07-11 17:54:03,625 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,1,1689098042452.64a1f72c6487e7f4ae550729b9dbcb83. 2023-07-11 17:54:03,625 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testScannerOnBulkLoadRefHFiles,1,1689098042452.64a1f72c6487e7f4ae550729b9dbcb83. 2023-07-11 17:54:03,625 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testScannerOnBulkLoadRefHFiles,2,1689098042452.47ee8c355f31465b357785487e314b0f. 2023-07-11 17:54:03,625 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 47ee8c355f31465b357785487e314b0f, NAME => 'testScannerOnBulkLoadRefHFiles,2,1689098042452.47ee8c355f31465b357785487e314b0f.', STARTKEY => '2', ENDKEY => ''} 2023-07-11 17:54:03,625 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles 47ee8c355f31465b357785487e314b0f 2023-07-11 17:54:03,625 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=64a1f72c6487e7f4ae550729b9dbcb83, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:03,626 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,2,1689098042452.47ee8c355f31465b357785487e314b0f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 17:54:03,626 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,1,1689098042452.64a1f72c6487e7f4ae550729b9dbcb83.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689098043625"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689098043625"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689098043625"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689098043625"}]},"ts":"1689098043625"} 2023-07-11 17:54:03,626 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 47ee8c355f31465b357785487e314b0f 2023-07-11 17:54:03,626 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 47ee8c355f31465b357785487e314b0f 2023-07-11 17:54:03,627 INFO [StoreOpener-47ee8c355f31465b357785487e314b0f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 47ee8c355f31465b357785487e314b0f 2023-07-11 17:54:03,628 DEBUG [StoreOpener-47ee8c355f31465b357785487e314b0f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testScannerOnBulkLoadRefHFiles/47ee8c355f31465b357785487e314b0f/family1 2023-07-11 17:54:03,628 DEBUG [StoreOpener-47ee8c355f31465b357785487e314b0f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testScannerOnBulkLoadRefHFiles/47ee8c355f31465b357785487e314b0f/family1 2023-07-11 17:54:03,629 INFO [StoreOpener-47ee8c355f31465b357785487e314b0f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 47ee8c355f31465b357785487e314b0f columnFamilyName family1 2023-07-11 17:54:03,629 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=32, resume processing ppid=29 2023-07-11 17:54:03,629 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=32, ppid=29, state=SUCCESS; OpenRegionProcedure 64a1f72c6487e7f4ae550729b9dbcb83, server=jenkins-hbase9.apache.org,45839,1689097999112 in 172 msec 2023-07-11 17:54:03,630 INFO [StoreOpener-47ee8c355f31465b357785487e314b0f-1] regionserver.HStore(310): Store=47ee8c355f31465b357785487e314b0f/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 17:54:03,630 INFO [StoreOpener-47ee8c355f31465b357785487e314b0f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 47ee8c355f31465b357785487e314b0f 2023-07-11 17:54:03,630 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=64a1f72c6487e7f4ae550729b9dbcb83, ASSIGN in 331 msec 2023-07-11 17:54:03,631 DEBUG [StoreOpener-47ee8c355f31465b357785487e314b0f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testScannerOnBulkLoadRefHFiles/47ee8c355f31465b357785487e314b0f/family2 2023-07-11 17:54:03,631 DEBUG [StoreOpener-47ee8c355f31465b357785487e314b0f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testScannerOnBulkLoadRefHFiles/47ee8c355f31465b357785487e314b0f/family2 2023-07-11 17:54:03,632 INFO [StoreOpener-47ee8c355f31465b357785487e314b0f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 47ee8c355f31465b357785487e314b0f columnFamilyName family2 2023-07-11 17:54:03,633 INFO [StoreOpener-47ee8c355f31465b357785487e314b0f-1] regionserver.HStore(310): Store=47ee8c355f31465b357785487e314b0f/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 17:54:03,634 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testScannerOnBulkLoadRefHFiles/47ee8c355f31465b357785487e314b0f 2023-07-11 17:54:03,634 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testScannerOnBulkLoadRefHFiles/47ee8c355f31465b357785487e314b0f 2023-07-11 17:54:03,635 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-07-11 17:54:03,636 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 47ee8c355f31465b357785487e314b0f 2023-07-11 17:54:03,638 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testScannerOnBulkLoadRefHFiles/47ee8c355f31465b357785487e314b0f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 17:54:03,638 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 47ee8c355f31465b357785487e314b0f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70892789, jitterRate=0.05638487637042999}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-07-11 17:54:03,638 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 47ee8c355f31465b357785487e314b0f: 2023-07-11 17:54:03,639 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,2,1689098042452.47ee8c355f31465b357785487e314b0f., pid=31, masterSystemTime=1689098043606 2023-07-11 17:54:03,640 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,2,1689098042452.47ee8c355f31465b357785487e314b0f. 2023-07-11 17:54:03,640 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testScannerOnBulkLoadRefHFiles,2,1689098042452.47ee8c355f31465b357785487e314b0f. 2023-07-11 17:54:03,640 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testScannerOnBulkLoadRefHFiles,,1689098042452.55b22085c6b006e3a631c2a366691bf8. 2023-07-11 17:54:03,641 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 55b22085c6b006e3a631c2a366691bf8, NAME => 'testScannerOnBulkLoadRefHFiles,,1689098042452.55b22085c6b006e3a631c2a366691bf8.', STARTKEY => '', ENDKEY => '1'} 2023-07-11 17:54:03,641 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=47ee8c355f31465b357785487e314b0f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:03,641 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles 55b22085c6b006e3a631c2a366691bf8 2023-07-11 17:54:03,641 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,2,1689098042452.47ee8c355f31465b357785487e314b0f.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1689098043641"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689098043641"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689098043641"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689098043641"}]},"ts":"1689098043641"} 2023-07-11 17:54:03,641 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,,1689098042452.55b22085c6b006e3a631c2a366691bf8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 17:54:03,641 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 55b22085c6b006e3a631c2a366691bf8 2023-07-11 17:54:03,641 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 55b22085c6b006e3a631c2a366691bf8 2023-07-11 17:54:03,642 INFO [StoreOpener-55b22085c6b006e3a631c2a366691bf8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 55b22085c6b006e3a631c2a366691bf8 2023-07-11 17:54:03,644 DEBUG [StoreOpener-55b22085c6b006e3a631c2a366691bf8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testScannerOnBulkLoadRefHFiles/55b22085c6b006e3a631c2a366691bf8/family1 2023-07-11 17:54:03,644 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=30 2023-07-11 17:54:03,644 DEBUG [StoreOpener-55b22085c6b006e3a631c2a366691bf8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testScannerOnBulkLoadRefHFiles/55b22085c6b006e3a631c2a366691bf8/family1 2023-07-11 17:54:03,644 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=30, state=SUCCESS; OpenRegionProcedure 47ee8c355f31465b357785487e314b0f, server=jenkins-hbase9.apache.org,45839,1689097999112 in 188 msec 2023-07-11 17:54:03,644 INFO [StoreOpener-55b22085c6b006e3a631c2a366691bf8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 55b22085c6b006e3a631c2a366691bf8 columnFamilyName family1 2023-07-11 17:54:03,645 INFO [StoreOpener-55b22085c6b006e3a631c2a366691bf8-1] regionserver.HStore(310): Store=55b22085c6b006e3a631c2a366691bf8/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 17:54:03,645 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=47ee8c355f31465b357785487e314b0f, ASSIGN in 346 msec 2023-07-11 17:54:03,645 INFO [StoreOpener-55b22085c6b006e3a631c2a366691bf8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 55b22085c6b006e3a631c2a366691bf8 2023-07-11 17:54:03,646 DEBUG [StoreOpener-55b22085c6b006e3a631c2a366691bf8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testScannerOnBulkLoadRefHFiles/55b22085c6b006e3a631c2a366691bf8/family2 2023-07-11 17:54:03,646 DEBUG [StoreOpener-55b22085c6b006e3a631c2a366691bf8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testScannerOnBulkLoadRefHFiles/55b22085c6b006e3a631c2a366691bf8/family2 2023-07-11 17:54:03,647 INFO [StoreOpener-55b22085c6b006e3a631c2a366691bf8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 55b22085c6b006e3a631c2a366691bf8 columnFamilyName family2 2023-07-11 17:54:03,648 INFO [StoreOpener-55b22085c6b006e3a631c2a366691bf8-1] regionserver.HStore(310): Store=55b22085c6b006e3a631c2a366691bf8/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 17:54:03,648 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testScannerOnBulkLoadRefHFiles/55b22085c6b006e3a631c2a366691bf8 2023-07-11 17:54:03,649 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testScannerOnBulkLoadRefHFiles/55b22085c6b006e3a631c2a366691bf8 2023-07-11 17:54:03,650 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-07-11 17:54:03,651 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 55b22085c6b006e3a631c2a366691bf8 2023-07-11 17:54:03,653 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testScannerOnBulkLoadRefHFiles/55b22085c6b006e3a631c2a366691bf8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 17:54:03,653 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 55b22085c6b006e3a631c2a366691bf8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65024744, jitterRate=-0.031055808067321777}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-07-11 17:54:03,653 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 55b22085c6b006e3a631c2a366691bf8: 2023-07-11 17:54:03,654 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,,1689098042452.55b22085c6b006e3a631c2a366691bf8., pid=33, masterSystemTime=1689098043606 2023-07-11 17:54:03,655 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,,1689098042452.55b22085c6b006e3a631c2a366691bf8. 2023-07-11 17:54:03,655 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testScannerOnBulkLoadRefHFiles,,1689098042452.55b22085c6b006e3a631c2a366691bf8. 2023-07-11 17:54:03,656 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=55b22085c6b006e3a631c2a366691bf8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:03,656 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,,1689098042452.55b22085c6b006e3a631c2a366691bf8.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1689098043656"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689098043656"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689098043656"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689098043656"}]},"ts":"1689098043656"} 2023-07-11 17:54:03,658 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=33, resume processing ppid=28 2023-07-11 17:54:03,659 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=33, ppid=28, state=SUCCESS; OpenRegionProcedure 55b22085c6b006e3a631c2a366691bf8, server=jenkins-hbase9.apache.org,45839,1689097999112 in 201 msec 2023-07-11 17:54:03,660 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=27 2023-07-11 17:54:03,660 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=55b22085c6b006e3a631c2a366691bf8, ASSIGN in 361 msec 2023-07-11 17:54:03,661 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-11 17:54:03,661 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testScannerOnBulkLoadRefHFiles","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689098043661"}]},"ts":"1689098043661"} 2023-07-11 17:54:03,662 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testScannerOnBulkLoadRefHFiles, state=ENABLED in hbase:meta 2023-07-11 17:54:03,664 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_POST_OPERATION 2023-07-11 17:54:03,665 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles in 1.2110 sec 2023-07-11 17:54:04,561 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-11 17:54:04,562 INFO [Listener at localhost/43271] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testScannerOnBulkLoadRefHFiles, procId: 27 completed 2023-07-11 17:54:04,568 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 17:54:04,570 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(165): Submitting procedure testScannerOnBulkLoadRefHFiles 2023-07-11 17:54:04,570 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testScannerOnBulkLoadRefHFiles' 2023-07-11 17:54:04,570 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:54:04,570 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' 2023-07-11 17:54:04,570 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testScannerOnBulkLoadRefHFiles', kicking off acquire phase on members. 2023-07-11 17:54:04,570 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-07-11 17:54:04,570 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-07-11 17:54:04,572 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:54:04,572 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:04,573 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:54:04,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:54:04,573 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:04,573 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 17:54:04,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-07-11 17:54:04,573 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-07-11 17:54:04,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 17:54:04,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-07-11 17:54:04,574 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testScannerOnBulkLoadRefHFiles 2023-07-11 17:54:04,574 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testScannerOnBulkLoadRefHFiles 2023-07-11 17:54:04,574 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testScannerOnBulkLoadRefHFiles' with timeout 60000ms 2023-07-11 17:54:04,574 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:54:04,574 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' stage 2023-07-11 17:54:04,574 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,2,1689098042452.47ee8c355f31465b357785487e314b0f. 2023-07-11 17:54:04,574 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,,1689098042452.55b22085c6b006e3a631c2a366691bf8. 2023-07-11 17:54:04,574 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,2,1689098042452.47ee8c355f31465b357785487e314b0f. started... 2023-07-11 17:54:04,574 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,,1689098042452.55b22085c6b006e3a631c2a366691bf8. started... 2023-07-11 17:54:04,575 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-07-11 17:54:04,575 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 47ee8c355f31465b357785487e314b0f 2/2 column families, dataSize=48 B heapSize=632 B 2023-07-11 17:54:04,575 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 55b22085c6b006e3a631c2a366691bf8: 2023-07-11 17:54:04,575 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,1,1689098042452.64a1f72c6487e7f4ae550729b9dbcb83. 2023-07-11 17:54:04,575 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 17:54:04,576 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,1,1689098042452.64a1f72c6487e7f4ae550729b9dbcb83. started... 2023-07-11 17:54:04,575 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,,1689098042452.55b22085c6b006e3a631c2a366691bf8. 2023-07-11 17:54:04,576 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-07-11 17:54:04,576 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 64a1f72c6487e7f4ae550729b9dbcb83: 2023-07-11 17:54:04,576 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,1,1689098042452.64a1f72c6487e7f4ae550729b9dbcb83. 2023-07-11 17:54:04,577 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-07-11 17:54:04,998 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230711b8c93983aea84cc19112012729d9c214 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20230711b8c93983aea84cc19112012729d9c214 2023-07-11 17:54:05,404 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=48, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testScannerOnBulkLoadRefHFiles/47ee8c355f31465b357785487e314b0f/.tmp/family1/371581b86c334a7abf86c8cc4e772830 2023-07-11 17:54:05,409 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testScannerOnBulkLoadRefHFiles/47ee8c355f31465b357785487e314b0f/.tmp/family1/371581b86c334a7abf86c8cc4e772830 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testScannerOnBulkLoadRefHFiles/47ee8c355f31465b357785487e314b0f/family1/371581b86c334a7abf86c8cc4e772830 2023-07-11 17:54:05,415 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testScannerOnBulkLoadRefHFiles/47ee8c355f31465b357785487e314b0f/family1/371581b86c334a7abf86c8cc4e772830, entries=1, sequenceid=5, filesize=4.9 K 2023-07-11 17:54:05,416 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~48 B/48, heapSize ~360 B/360, currentSize=0 B/0 for 47ee8c355f31465b357785487e314b0f in 841ms, sequenceid=5, compaction requested=false 2023-07-11 17:54:05,416 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testScannerOnBulkLoadRefHFiles' 2023-07-11 17:54:05,416 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 47ee8c355f31465b357785487e314b0f: 2023-07-11 17:54:05,416 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,2,1689098042452.47ee8c355f31465b357785487e314b0f. 2023-07-11 17:54:05,416 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-07-11 17:54:05,416 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-07-11 17:54:05,416 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:05,416 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally acquired 2023-07-11 17:54:05,416 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure (testScannerOnBulkLoadRefHFiles) in zk 2023-07-11 17:54:05,418 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:05,418 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-07-11 17:54:05,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:05,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:54:05,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:54:05,418 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-07-11 17:54:05,418 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testScannerOnBulkLoadRefHFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 17:54:05,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:54:05,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:54:05,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-07-11 17:54:05,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:05,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:54:05,420 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure 'testScannerOnBulkLoadRefHFiles' on coordinator 2023-07-11 17:54:05,420 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@43be4f15[Count = 0] remaining members to acquire global barrier 2023-07-11 17:54:05,420 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'in-barrier' execution. 2023-07-11 17:54:05,420 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-07-11 17:54:05,421 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-07-11 17:54:05,421 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-07-11 17:54:05,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-07-11 17:54:05,421 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testScannerOnBulkLoadRefHFiles' received 'reached' from coordinator. 2023-07-11 17:54:05,421 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally completed 2023-07-11 17:54:05,421 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testScannerOnBulkLoadRefHFiles' completed for member 'jenkins-hbase9.apache.org,45839,1689097999112' in zk 2023-07-11 17:54:05,421 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:05,421 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 17:54:05,422 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testScannerOnBulkLoadRefHFiles' has notified controller of completion 2023-07-11 17:54:05,423 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:54:05,422 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:05,423 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testScannerOnBulkLoadRefHFiles' completed. 2023-07-11 17:54:05,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:05,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:54:05,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:54:05,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:54:05,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:54:05,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-07-11 17:54:05,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:05,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:54:05,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-07-11 17:54:05,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:05,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testScannerOnBulkLoadRefHFiles' member 'jenkins-hbase9.apache.org,45839,1689097999112': 2023-07-11 17:54:05,425 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' released barrier for procedure'testScannerOnBulkLoadRefHFiles', counting down latch. Waiting for 0 more 2023-07-11 17:54:05,425 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testScannerOnBulkLoadRefHFiles' execution completed 2023-07-11 17:54:05,425 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 17:54:05,425 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 17:54:05,425 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testScannerOnBulkLoadRefHFiles 2023-07-11 17:54:05,425 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testScannerOnBulkLoadRefHFilesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 17:54:05,427 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-07-11 17:54:05,427 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-07-11 17:54:05,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-07-11 17:54:05,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:54:05,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:54:05,428 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-07-11 17:54:05,428 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:54:05,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-07-11 17:54:05,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:54:05,428 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:54:05,428 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:05,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:54:05,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-07-11 17:54:05,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-07-11 17:54:05,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:54:05,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-07-11 17:54:05,429 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:05,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:05,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:54:05,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-07-11 17:54:05,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:05,434 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:05,434 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:54:05,434 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-07-11 17:54:05,434 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testScannerOnBulkLoadRefHFiles' 2023-07-11 17:54:05,434 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 17:54:05,434 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles because node does not exist (not an error) 2023-07-11 17:54:05,434 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-07-11 17:54:05,434 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:54:05,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:54:05,434 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:54:05,434 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:54:05,434 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testScannerOnBulkLoadRefHFiles'' to complete. (max 300000 ms per retry) 2023-07-11 17:54:05,434 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:54:05,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:54:05,434 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:05,434 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 17:54:05,434 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-07-11 17:54:05,434 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-07-11 17:54:05,435 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-07-11 17:54:05,535 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 17:54:05,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 17:54:05,540 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 17:54:05,541 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(143): Procedure testScannerOnBulkLoadRefHFiles was in running list but was completed. Accepting new attempt. 2023-07-11 17:54:05,541 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(165): Submitting procedure testScannerOnBulkLoadRefHFiles 2023-07-11 17:54:05,541 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testScannerOnBulkLoadRefHFiles' 2023-07-11 17:54:05,541 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:54:05,541 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' 2023-07-11 17:54:05,542 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testScannerOnBulkLoadRefHFiles', kicking off acquire phase on members. 2023-07-11 17:54:05,542 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-07-11 17:54:05,542 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-07-11 17:54:05,543 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:05,543 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:54:05,543 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:54:05,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:54:05,543 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:05,543 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 17:54:05,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-07-11 17:54:05,544 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-07-11 17:54:05,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 17:54:05,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-07-11 17:54:05,544 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testScannerOnBulkLoadRefHFiles 2023-07-11 17:54:05,544 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testScannerOnBulkLoadRefHFiles is still present, removing 2023-07-11 17:54:05,545 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testScannerOnBulkLoadRefHFiles 2023-07-11 17:54:05,545 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testScannerOnBulkLoadRefHFiles' with timeout 60000ms 2023-07-11 17:54:05,545 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:54:05,545 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' stage 2023-07-11 17:54:05,545 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,2,1689098042452.47ee8c355f31465b357785487e314b0f. 2023-07-11 17:54:05,545 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,2,1689098042452.47ee8c355f31465b357785487e314b0f. started... 2023-07-11 17:54:05,545 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-07-11 17:54:05,545 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 17:54:05,545 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,1,1689098042452.64a1f72c6487e7f4ae550729b9dbcb83. 2023-07-11 17:54:05,545 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,,1689098042452.55b22085c6b006e3a631c2a366691bf8. 2023-07-11 17:54:05,545 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,1,1689098042452.64a1f72c6487e7f4ae550729b9dbcb83. started... 2023-07-11 17:54:05,545 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 47ee8c355f31465b357785487e314b0f 2/2 column families, dataSize=90 B heapSize=752 B 2023-07-11 17:54:05,545 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,,1689098042452.55b22085c6b006e3a631c2a366691bf8. started... 2023-07-11 17:54:05,545 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 64a1f72c6487e7f4ae550729b9dbcb83: 2023-07-11 17:54:05,545 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,1,1689098042452.64a1f72c6487e7f4ae550729b9dbcb83. 2023-07-11 17:54:05,545 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 55b22085c6b006e3a631c2a366691bf8: 2023-07-11 17:54:05,545 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,,1689098042452.55b22085c6b006e3a631c2a366691bf8. 2023-07-11 17:54:05,545 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-07-11 17:54:05,546 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-07-11 17:54:05,958 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230711709adf7b78b2497e8d6a3ef675a491ad to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20230711709adf7b78b2497e8d6a3ef675a491ad 2023-07-11 17:54:06,364 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=90, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testScannerOnBulkLoadRefHFiles/47ee8c355f31465b357785487e314b0f/.tmp/family1/de369d988a3745f69f0b8f99f5bdb281 2023-07-11 17:54:06,369 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testScannerOnBulkLoadRefHFiles/47ee8c355f31465b357785487e314b0f/.tmp/family1/de369d988a3745f69f0b8f99f5bdb281 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testScannerOnBulkLoadRefHFiles/47ee8c355f31465b357785487e314b0f/family1/de369d988a3745f69f0b8f99f5bdb281 2023-07-11 17:54:06,374 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testScannerOnBulkLoadRefHFiles/47ee8c355f31465b357785487e314b0f/family1/de369d988a3745f69f0b8f99f5bdb281, entries=2, sequenceid=9, filesize=5.0 K 2023-07-11 17:54:06,375 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~90 B/90, heapSize ~480 B/480, currentSize=0 B/0 for 47ee8c355f31465b357785487e314b0f in 830ms, sequenceid=9, compaction requested=false 2023-07-11 17:54:06,375 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 47ee8c355f31465b357785487e314b0f: 2023-07-11 17:54:06,375 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,2,1689098042452.47ee8c355f31465b357785487e314b0f. 2023-07-11 17:54:06,375 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-07-11 17:54:06,375 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-07-11 17:54:06,375 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:06,376 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally acquired 2023-07-11 17:54:06,376 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure (testScannerOnBulkLoadRefHFiles) in zk 2023-07-11 17:54:06,377 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-07-11 17:54:06,377 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:06,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:06,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:54:06,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:54:06,378 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-07-11 17:54:06,378 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testScannerOnBulkLoadRefHFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 17:54:06,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:54:06,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:54:06,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-07-11 17:54:06,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:06,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:54:06,379 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure 'testScannerOnBulkLoadRefHFiles' on coordinator 2023-07-11 17:54:06,379 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6d1b8370[Count = 0] remaining members to acquire global barrier 2023-07-11 17:54:06,379 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'in-barrier' execution. 2023-07-11 17:54:06,379 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-07-11 17:54:06,382 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-07-11 17:54:06,382 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-07-11 17:54:06,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-07-11 17:54:06,382 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testScannerOnBulkLoadRefHFiles' received 'reached' from coordinator. 2023-07-11 17:54:06,382 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally completed 2023-07-11 17:54:06,382 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testScannerOnBulkLoadRefHFiles' completed for member 'jenkins-hbase9.apache.org,45839,1689097999112' in zk 2023-07-11 17:54:06,382 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:06,382 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 17:54:06,383 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:06,383 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testScannerOnBulkLoadRefHFiles' has notified controller of completion 2023-07-11 17:54:06,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:06,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:54:06,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:54:06,383 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:54:06,384 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testScannerOnBulkLoadRefHFiles' completed. 2023-07-11 17:54:06,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:54:06,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:54:06,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-07-11 17:54:06,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:06,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:54:06,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-07-11 17:54:06,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:06,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testScannerOnBulkLoadRefHFiles' member 'jenkins-hbase9.apache.org,45839,1689097999112': 2023-07-11 17:54:06,386 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' released barrier for procedure'testScannerOnBulkLoadRefHFiles', counting down latch. Waiting for 0 more 2023-07-11 17:54:06,386 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testScannerOnBulkLoadRefHFiles' execution completed 2023-07-11 17:54:06,386 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 17:54:06,386 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 17:54:06,386 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testScannerOnBulkLoadRefHFiles 2023-07-11 17:54:06,386 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testScannerOnBulkLoadRefHFilesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 17:54:06,388 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-07-11 17:54:06,388 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:54:06,388 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-07-11 17:54:06,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-07-11 17:54:06,388 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-07-11 17:54:06,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-07-11 17:54:06,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:54:06,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:54:06,389 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:54:06,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:54:06,389 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:06,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:54:06,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-07-11 17:54:06,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-07-11 17:54:06,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:54:06,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-07-11 17:54:06,390 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:06,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:06,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:54:06,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-07-11 17:54:06,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:06,392 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:06,392 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:54:06,392 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-07-11 17:54:06,392 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:54:06,392 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testScannerOnBulkLoadRefHFiles' 2023-07-11 17:54:06,392 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 17:54:06,392 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:54:06,392 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-07-11 17:54:06,392 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:06,392 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-07-11 17:54:06,392 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:54:06,392 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-07-11 17:54:06,392 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-07-11 17:54:06,392 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testScannerOnBulkLoadRefHFiles'' to complete. (max 300000 ms per retry) 2023-07-11 17:54:06,393 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 17:54:06,392 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles because node does not exist (not an error) 2023-07-11 17:54:06,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:54:06,393 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:54:06,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:54:06,493 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 17:54:06,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 17:54:06,500 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=36885] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testScannerOnBulkLoadRefHFiles 2023-07-11 17:54:06,502 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-07-11 17:54:06,502 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-07-11 17:54:06,503 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] mob.MobUtils(833): start MOB compaction of files for table='testScannerOnBulkLoadRefHFiles', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-07-11 17:54:06,503 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1689098646503 2023-07-11 17:54:06,504 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-07-11 17:54:06,504 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 2 selected files, and 0 irrelevant files table 'testScannerOnBulkLoadRefHFiles' and column 'family1' 2023-07-11 17:54:06,504 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-07-11 17:54:06,505 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] zookeeper.ReadOnlyZKClient(139): Connect 0x046d775d to 127.0.0.1:50702 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 17:54:06,510 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@25983ed6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 17:54:06,510 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230711 for table='testScannerOnBulkLoadRefHFiles' and column='family1' 2023-07-11 17:54:07,339 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202307117624b51254f1415f937248c66422ca9d to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202307117624b51254f1415f937248c66422ca9d 2023-07-11 17:54:07,340 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230711 table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-07-11 17:54:07,354 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 17:54:07,356 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:58992, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 17:54:07,363 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-11 17:54:07,365 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:58408, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-11 17:54:07,374 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230711/family1/d71edeb82d494f3f959da243f24a4c76 first=Optional[k0] last=Optional[k1] 2023-07-11 17:54:07,375 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testScannerOnBulkLoadRefHFiles,2,1689098042452.47ee8c355f31465b357785487e314b0f., hostname=jenkins-hbase9.apache.org,45839,1689097999112, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230711/family1/d71edeb82d494f3f959da243f24a4c76}] 2023-07-11 17:54:07,379 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(763): Validating hfile at hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230711/family1/d71edeb82d494f3f959da243f24a4c76 for inclusion in 47ee8c355f31465b357785487e314b0f/family1 2023-07-11 17:54:07,382 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(775): HFile bounds: first=k0 last=k1 2023-07-11 17:54:07,382 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(777): Region bounds: first=2 last= 2023-07-11 17:54:07,382 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HRegion(2446): Flush status journal for 47ee8c355f31465b357785487e314b0f: 2023-07-11 17:54:07,383 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230711/family1/d71edeb82d494f3f959da243f24a4c76 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testScannerOnBulkLoadRefHFiles__7p21kdd0im4m28lrnkavij9c3qt9rmrgsh2thi1lvgkh7sj4jqv3na4kau45puqo/family1/d71edeb82d494f3f959da243f24a4c76 2023-07-11 17:54:07,386 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testScannerOnBulkLoadRefHFiles__7p21kdd0im4m28lrnkavij9c3qt9rmrgsh2thi1lvgkh7sj4jqv3na4kau45puqo/family1/d71edeb82d494f3f959da243f24a4c76 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testScannerOnBulkLoadRefHFiles/47ee8c355f31465b357785487e314b0f/family1/b232229614494eaca3dd133c3a9ebe2c_SeqId_12_ 2023-07-11 17:54:07,386 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(849): Loaded HFile hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testScannerOnBulkLoadRefHFiles__7p21kdd0im4m28lrnkavij9c3qt9rmrgsh2thi1lvgkh7sj4jqv3na4kau45puqo/family1/d71edeb82d494f3f959da243f24a4c76 into 47ee8c355f31465b357785487e314b0f/family1 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testScannerOnBulkLoadRefHFiles/47ee8c355f31465b357785487e314b0f/family1/b232229614494eaca3dd133c3a9ebe2c_SeqId_12_ - updating store file list. 2023-07-11 17:54:07,390 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(882): Loaded HFile hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testScannerOnBulkLoadRefHFiles/47ee8c355f31465b357785487e314b0f/family1/b232229614494eaca3dd133c3a9ebe2c_SeqId_12_ into 47ee8c355f31465b357785487e314b0f/family1 2023-07-11 17:54:07,390 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(855): Successfully loaded hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testScannerOnBulkLoadRefHFiles__7p21kdd0im4m28lrnkavij9c3qt9rmrgsh2thi1lvgkh7sj4jqv3na4kau45puqo/family1/d71edeb82d494f3f959da243f24a4c76 into 47ee8c355f31465b357785487e314b0f/family1 (new location: hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testScannerOnBulkLoadRefHFiles/47ee8c355f31465b357785487e314b0f/family1/b232229614494eaca3dd133c3a9ebe2c_SeqId_12_) 2023-07-11 17:54:07,391 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testScannerOnBulkLoadRefHFiles__7p21kdd0im4m28lrnkavij9c3qt9rmrgsh2thi1lvgkh7sj4jqv3na4kau45puqo/family1/d71edeb82d494f3f959da243f24a4c76 2023-07-11 17:54:07,391 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-07-11 17:54:07,392 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 15445 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-07-11 17:54:07,392 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(1912): 47ee8c355f31465b357785487e314b0f/family1 is initiating minor compaction (all files) 2023-07-11 17:54:07,392 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@2a47a8b1; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-11 17:54:07,392 INFO [RS:0;jenkins-hbase9:45839-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 47ee8c355f31465b357785487e314b0f/family1 in testScannerOnBulkLoadRefHFiles,2,1689098042452.47ee8c355f31465b357785487e314b0f. 2023-07-11 17:54:07,392 INFO [RS:0;jenkins-hbase9:45839-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testScannerOnBulkLoadRefHFiles/47ee8c355f31465b357785487e314b0f/family1/371581b86c334a7abf86c8cc4e772830, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testScannerOnBulkLoadRefHFiles/47ee8c355f31465b357785487e314b0f/family1/de369d988a3745f69f0b8f99f5bdb281, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testScannerOnBulkLoadRefHFiles/47ee8c355f31465b357785487e314b0f/family1/b232229614494eaca3dd133c3a9ebe2c_SeqId_12_] into tmpdir=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testScannerOnBulkLoadRefHFiles/47ee8c355f31465b357785487e314b0f/.tmp, totalSize=15.1 K 2023-07-11 17:54:07,393 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] compactions.Compactor(207): Compacting 371581b86c334a7abf86c8cc4e772830, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1689098044562 2023-07-11 17:54:07,393 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] compactions.Compactor(207): Compacting de369d988a3745f69f0b8f99f5bdb281, keycount=2, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1689098044562 2023-07-11 17:54:07,394 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] compactions.Compactor(207): Compacting b232229614494eaca3dd133c3a9ebe2c_SeqId_12_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1689098044562 2023-07-11 17:54:07,394 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230711 table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-07-11 17:54:07,395 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 17:54:07,397 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20230711709adf7b78b2497e8d6a3ef675a491ad to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20230711709adf7b78b2497e8d6a3ef675a491ad 2023-07-11 17:54:07,398 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20230711b8c93983aea84cc19112012729d9c214 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20230711b8c93983aea84cc19112012729d9c214 2023-07-11 17:54:07,398 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testScannerOnBulkLoadRefHFiles 2 expired mob files are deleted 2023-07-11 17:54:07,398 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230711' 2023-07-11 17:54:07,399 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230711 for table='testScannerOnBulkLoadRefHFiles' and column='family1' 2023-07-11 17:54:07,399 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] compactions.PartitionedMobCompactor(354): After compaction, there are 1 mob files. table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-07-11 17:54:07,399 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] mob.MobUtils(840): end MOB compaction of files for table='testScannerOnBulkLoadRefHFiles', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-07-11 17:54:07,400 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-07-11 17:54:07,402 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE in 899 msec 2023-07-11 17:54:07,405 INFO [RS:0;jenkins-hbase9:45839-shortCompactions-0] throttle.PressureAwareThroughputController(145): 47ee8c355f31465b357785487e314b0f#family1#compaction#37 average throughput is 0.06 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-11 17:54:07,439 INFO [Listener at localhost/43271] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testScannerOnBulkLoadRefHFiles Thread=248 (was 248), OpenFileDescriptor=589 (was 592), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=151 (was 164), ProcessCount=170 (was 170), AvailableMemoryMB=8661 (was 8666) 2023-07-11 17:54:07,450 INFO [Listener at localhost/43271] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyPolicy Thread=248, OpenFileDescriptor=589, MaxFileDescriptor=60000, SystemLoadAverage=151, ProcessCount=170, AvailableMemoryMB=8660 2023-07-11 17:54:07,452 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testMajorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-07-11 17:54:07,453 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:07,454 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-07-11 17:54:07,455 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyPolicy" procId is: 35 2023-07-11 17:54:07,455 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-11 17:54:07,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-07-11 17:54:07,456 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/86ac0fab4b9c1edad19043fde0c2391a 2023-07-11 17:54:07,457 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/86ac0fab4b9c1edad19043fde0c2391a empty. 2023-07-11 17:54:07,457 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/86ac0fab4b9c1edad19043fde0c2391a 2023-07-11 17:54:07,457 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyPolicy regions 2023-07-11 17:54:07,465 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/.tabledesc/.tableinfo.0000000001 2023-07-11 17:54:07,467 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => 86ac0fab4b9c1edad19043fde0c2391a, NAME => 'testMajorCompactionWithWeeklyPolicy,,1689098047452.86ac0fab4b9c1edad19043fde0c2391a.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/.tmp 2023-07-11 17:54:07,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-07-11 17:54:07,757 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-07-11 17:54:07,874 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyPolicy,,1689098047452.86ac0fab4b9c1edad19043fde0c2391a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 17:54:07,874 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1604): Closing 86ac0fab4b9c1edad19043fde0c2391a, disabling compactions & flushes 2023-07-11 17:54:07,874 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyPolicy,,1689098047452.86ac0fab4b9c1edad19043fde0c2391a. 2023-07-11 17:54:07,874 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyPolicy,,1689098047452.86ac0fab4b9c1edad19043fde0c2391a. 2023-07-11 17:54:07,874 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyPolicy,,1689098047452.86ac0fab4b9c1edad19043fde0c2391a. after waiting 0 ms 2023-07-11 17:54:07,874 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyPolicy,,1689098047452.86ac0fab4b9c1edad19043fde0c2391a. 2023-07-11 17:54:07,874 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyPolicy,,1689098047452.86ac0fab4b9c1edad19043fde0c2391a. 2023-07-11 17:54:07,874 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for 86ac0fab4b9c1edad19043fde0c2391a: 2023-07-11 17:54:07,877 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-07-11 17:54:07,878 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyPolicy,,1689098047452.86ac0fab4b9c1edad19043fde0c2391a.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1689098047878"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689098047878"}]},"ts":"1689098047878"} 2023-07-11 17:54:07,879 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-11 17:54:07,880 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-11 17:54:07,880 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689098047880"}]},"ts":"1689098047880"} 2023-07-11 17:54:07,881 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyPolicy, state=ENABLING in hbase:meta 2023-07-11 17:54:07,884 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=86ac0fab4b9c1edad19043fde0c2391a, ASSIGN}] 2023-07-11 17:54:07,885 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=86ac0fab4b9c1edad19043fde0c2391a, ASSIGN 2023-07-11 17:54:07,886 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=86ac0fab4b9c1edad19043fde0c2391a, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,45839,1689097999112; forceNewPlan=false, retain=false 2023-07-11 17:54:08,037 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=86ac0fab4b9c1edad19043fde0c2391a, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:08,037 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyPolicy,,1689098047452.86ac0fab4b9c1edad19043fde0c2391a.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1689098048037"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689098048037"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689098048037"}]},"ts":"1689098048037"} 2023-07-11 17:54:08,039 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE; OpenRegionProcedure 86ac0fab4b9c1edad19043fde0c2391a, server=jenkins-hbase9.apache.org,45839,1689097999112}] 2023-07-11 17:54:08,059 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-07-11 17:54:08,194 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyPolicy,,1689098047452.86ac0fab4b9c1edad19043fde0c2391a. 2023-07-11 17:54:08,194 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 86ac0fab4b9c1edad19043fde0c2391a, NAME => 'testMajorCompactionWithWeeklyPolicy,,1689098047452.86ac0fab4b9c1edad19043fde0c2391a.', STARTKEY => '', ENDKEY => ''} 2023-07-11 17:54:08,194 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyPolicy 86ac0fab4b9c1edad19043fde0c2391a 2023-07-11 17:54:08,195 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyPolicy,,1689098047452.86ac0fab4b9c1edad19043fde0c2391a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 17:54:08,195 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 86ac0fab4b9c1edad19043fde0c2391a 2023-07-11 17:54:08,195 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 86ac0fab4b9c1edad19043fde0c2391a 2023-07-11 17:54:08,196 INFO [StoreOpener-86ac0fab4b9c1edad19043fde0c2391a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 86ac0fab4b9c1edad19043fde0c2391a 2023-07-11 17:54:08,197 DEBUG [StoreOpener-86ac0fab4b9c1edad19043fde0c2391a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyPolicy/86ac0fab4b9c1edad19043fde0c2391a/family1 2023-07-11 17:54:08,197 DEBUG [StoreOpener-86ac0fab4b9c1edad19043fde0c2391a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyPolicy/86ac0fab4b9c1edad19043fde0c2391a/family1 2023-07-11 17:54:08,198 INFO [StoreOpener-86ac0fab4b9c1edad19043fde0c2391a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 86ac0fab4b9c1edad19043fde0c2391a columnFamilyName family1 2023-07-11 17:54:08,199 INFO [StoreOpener-86ac0fab4b9c1edad19043fde0c2391a-1] regionserver.HStore(310): Store=86ac0fab4b9c1edad19043fde0c2391a/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 17:54:08,200 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyPolicy/86ac0fab4b9c1edad19043fde0c2391a 2023-07-11 17:54:08,201 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyPolicy/86ac0fab4b9c1edad19043fde0c2391a 2023-07-11 17:54:08,203 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 86ac0fab4b9c1edad19043fde0c2391a 2023-07-11 17:54:08,205 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyPolicy/86ac0fab4b9c1edad19043fde0c2391a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 17:54:08,206 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 86ac0fab4b9c1edad19043fde0c2391a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62566082, jitterRate=-0.06769272685050964}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 17:54:08,206 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 86ac0fab4b9c1edad19043fde0c2391a: 2023-07-11 17:54:08,206 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyPolicy,,1689098047452.86ac0fab4b9c1edad19043fde0c2391a., pid=37, masterSystemTime=1689098048191 2023-07-11 17:54:08,208 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyPolicy,,1689098047452.86ac0fab4b9c1edad19043fde0c2391a. 2023-07-11 17:54:08,208 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyPolicy,,1689098047452.86ac0fab4b9c1edad19043fde0c2391a. 2023-07-11 17:54:08,208 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=86ac0fab4b9c1edad19043fde0c2391a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:08,209 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyPolicy,,1689098047452.86ac0fab4b9c1edad19043fde0c2391a.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1689098048208"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689098048208"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689098048208"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689098048208"}]},"ts":"1689098048208"} 2023-07-11 17:54:08,212 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=37, resume processing ppid=36 2023-07-11 17:54:08,212 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; OpenRegionProcedure 86ac0fab4b9c1edad19043fde0c2391a, server=jenkins-hbase9.apache.org,45839,1689097999112 in 171 msec 2023-07-11 17:54:08,214 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=36, resume processing ppid=35 2023-07-11 17:54:08,214 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=36, ppid=35, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=86ac0fab4b9c1edad19043fde0c2391a, ASSIGN in 328 msec 2023-07-11 17:54:08,214 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-11 17:54:08,215 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689098048214"}]},"ts":"1689098048214"} 2023-07-11 17:54:08,216 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyPolicy, state=ENABLED in hbase:meta 2023-07-11 17:54:08,218 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-07-11 17:54:08,219 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy in 766 msec 2023-07-11 17:54:08,237 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testScannerOnBulkLoadRefHFiles/47ee8c355f31465b357785487e314b0f/.tmp/family1/dfe57cf7fb0e408ca19ed854ef03488c as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testScannerOnBulkLoadRefHFiles/47ee8c355f31465b357785487e314b0f/family1/dfe57cf7fb0e408ca19ed854ef03488c 2023-07-11 17:54:08,243 INFO [RS:0;jenkins-hbase9:45839-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 47ee8c355f31465b357785487e314b0f/family1 of 47ee8c355f31465b357785487e314b0f into dfe57cf7fb0e408ca19ed854ef03488c(size=5.1 K), total size for store is 5.1 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-11 17:54:08,243 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 47ee8c355f31465b357785487e314b0f: 2023-07-11 17:54:08,243 INFO [RS:0;jenkins-hbase9:45839-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testScannerOnBulkLoadRefHFiles,2,1689098042452.47ee8c355f31465b357785487e314b0f., storeName=family1, fileCount=3, fileSize=15.1 K (4.9 K, 5.0 K, 5.2 K), priority=2, time=1689098047392; duration=0sec 2023-07-11 17:54:08,244 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-11 17:54:08,341 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testScannerOnBulkLoadRefHFiles/47ee8c355f31465b357785487e314b0f/family1/371581b86c334a7abf86c8cc4e772830, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testScannerOnBulkLoadRefHFiles/47ee8c355f31465b357785487e314b0f/family1/de369d988a3745f69f0b8f99f5bdb281, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testScannerOnBulkLoadRefHFiles/47ee8c355f31465b357785487e314b0f/family1/b232229614494eaca3dd133c3a9ebe2c_SeqId_12_] to archive 2023-07-11 17:54:08,342 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 17:54:08,344 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testScannerOnBulkLoadRefHFiles/47ee8c355f31465b357785487e314b0f/family1/371581b86c334a7abf86c8cc4e772830 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testScannerOnBulkLoadRefHFiles/47ee8c355f31465b357785487e314b0f/family1/371581b86c334a7abf86c8cc4e772830 2023-07-11 17:54:08,346 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testScannerOnBulkLoadRefHFiles/47ee8c355f31465b357785487e314b0f/family1/de369d988a3745f69f0b8f99f5bdb281 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testScannerOnBulkLoadRefHFiles/47ee8c355f31465b357785487e314b0f/family1/de369d988a3745f69f0b8f99f5bdb281 2023-07-11 17:54:08,347 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testScannerOnBulkLoadRefHFiles/47ee8c355f31465b357785487e314b0f/family1/b232229614494eaca3dd133c3a9ebe2c_SeqId_12_ to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testScannerOnBulkLoadRefHFiles/47ee8c355f31465b357785487e314b0f/family1/b232229614494eaca3dd133c3a9ebe2c_SeqId_12_ 2023-07-11 17:54:08,365 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyPolicy' 2023-07-11 17:54:08,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-07-11 17:54:08,561 INFO [Listener at localhost/43271] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyPolicy, procId: 35 completed 2023-07-11 17:54:08,583 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 17:54:08,585 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:08,585 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-07-11 17:54:08,585 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:54:08,585 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-07-11 17:54:08,585 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-07-11 17:54:08,585 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:08,585 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:08,588 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:54:08,588 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:08,588 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:54:08,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:54:08,588 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:08,588 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 17:54:08,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:08,589 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:08,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 17:54:08,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:08,589 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:08,589 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:08,589 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-07-11 17:54:08,589 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:54:08,589 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-07-11 17:54:08,589 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 17:54:08,589 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 17:54:08,590 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1689098047452.86ac0fab4b9c1edad19043fde0c2391a. 2023-07-11 17:54:08,590 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1689098047452.86ac0fab4b9c1edad19043fde0c2391a. started... 2023-07-11 17:54:08,590 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 86ac0fab4b9c1edad19043fde0c2391a 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-07-11 17:54:09,011 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015113041628bfd469042349c0134278b2b2a66 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015113041628bfd469042349c0134278b2b2a66 2023-07-11 17:54:09,138 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-07-11 17:54:09,415 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyPolicy/86ac0fab4b9c1edad19043fde0c2391a/.tmp/family1/60cab8263e274836ac19f8efbbb0e643 2023-07-11 17:54:09,421 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyPolicy/86ac0fab4b9c1edad19043fde0c2391a/.tmp/family1/60cab8263e274836ac19f8efbbb0e643 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyPolicy/86ac0fab4b9c1edad19043fde0c2391a/family1/60cab8263e274836ac19f8efbbb0e643 2023-07-11 17:54:09,426 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyPolicy/86ac0fab4b9c1edad19043fde0c2391a/family1/60cab8263e274836ac19f8efbbb0e643, entries=1000, sequenceid=5, filesize=165.1 K 2023-07-11 17:54:09,427 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 86ac0fab4b9c1edad19043fde0c2391a in 837ms, sequenceid=5, compaction requested=false 2023-07-11 17:54:09,427 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 86ac0fab4b9c1edad19043fde0c2391a: 2023-07-11 17:54:09,427 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1689098047452.86ac0fab4b9c1edad19043fde0c2391a. 2023-07-11 17:54:09,427 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 17:54:09,427 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 17:54:09,427 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:09,427 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-07-11 17:54:09,428 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-07-11 17:54:09,429 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:09,429 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:09,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:09,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:54:09,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:54:09,429 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:09,429 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 17:54:09,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:54:09,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:54:09,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:09,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:09,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:54:09,431 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-07-11 17:54:09,431 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2087680e[Count = 0] remaining members to acquire global barrier 2023-07-11 17:54:09,431 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-07-11 17:54:09,431 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:09,432 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:09,432 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:09,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:09,432 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-07-11 17:54:09,432 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-07-11 17:54:09,432 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase9.apache.org,45839,1689097999112' in zk 2023-07-11 17:54:09,432 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:09,432 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 17:54:09,433 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:09,433 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-07-11 17:54:09,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:09,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:54:09,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:54:09,433 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:54:09,433 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-07-11 17:54:09,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:54:09,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:54:09,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:09,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:09,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:54:09,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:09,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:09,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase9.apache.org,45839,1689097999112': 2023-07-11 17:54:09,435 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-07-11 17:54:09,435 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-07-11 17:54:09,435 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 17:54:09,435 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 17:54:09,435 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:09,435 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 17:54:09,437 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:09,438 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:09,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:09,438 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:09,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:54:09,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:54:09,438 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:54:09,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:09,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:54:09,438 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:09,438 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:54:09,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:54:09,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:09,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:09,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:54:09,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:09,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:09,439 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:09,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:54:09,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:09,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:09,441 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:09,441 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:09,441 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:54:09,441 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:09,441 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:54:09,441 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-07-11 17:54:09,441 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 17:54:09,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:54:09,441 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:09,441 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:54:09,441 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:54:09,442 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:09,442 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:09,442 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:09,442 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-07-11 17:54:09,442 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 17:54:09,442 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:54:09,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:54:09,542 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 17:54:09,543 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 17:54:09,547 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 17:54:09,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-07-11 17:54:09,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:09,548 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-07-11 17:54:09,548 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:54:09,548 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-07-11 17:54:09,548 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-07-11 17:54:09,549 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:09,549 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:09,550 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:09,550 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:54:09,550 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:54:09,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:54:09,550 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:09,550 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 17:54:09,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:09,551 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:09,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 17:54:09,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:09,551 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:09,551 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-07-11 17:54:09,551 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:09,551 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-07-11 17:54:09,551 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:54:09,551 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-07-11 17:54:09,551 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 17:54:09,551 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 17:54:09,552 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1689098047452.86ac0fab4b9c1edad19043fde0c2391a. 2023-07-11 17:54:09,552 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1689098047452.86ac0fab4b9c1edad19043fde0c2391a. started... 2023-07-11 17:54:09,552 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 86ac0fab4b9c1edad19043fde0c2391a 1/1 column families, dataSize=74 B heapSize=408 B 2023-07-11 17:54:09,965 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511288bb840a64c04418c90194235552a50ac to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201511288bb840a64c04418c90194235552a50ac 2023-07-11 17:54:10,370 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyPolicy/86ac0fab4b9c1edad19043fde0c2391a/.tmp/family1/a8a0fd2f95134396a4126b364c315f4b 2023-07-11 17:54:10,375 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyPolicy/86ac0fab4b9c1edad19043fde0c2391a/.tmp/family1/a8a0fd2f95134396a4126b364c315f4b as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyPolicy/86ac0fab4b9c1edad19043fde0c2391a/family1/a8a0fd2f95134396a4126b364c315f4b 2023-07-11 17:54:10,380 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyPolicy/86ac0fab4b9c1edad19043fde0c2391a/family1/a8a0fd2f95134396a4126b364c315f4b, entries=1, sequenceid=9, filesize=5.0 K 2023-07-11 17:54:10,381 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 86ac0fab4b9c1edad19043fde0c2391a in 829ms, sequenceid=9, compaction requested=false 2023-07-11 17:54:10,381 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 86ac0fab4b9c1edad19043fde0c2391a: 2023-07-11 17:54:10,381 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1689098047452.86ac0fab4b9c1edad19043fde0c2391a. 2023-07-11 17:54:10,381 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 17:54:10,381 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 17:54:10,381 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:10,381 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-07-11 17:54:10,381 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-07-11 17:54:10,383 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:10,383 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:10,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:10,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:54:10,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:54:10,383 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:10,383 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 17:54:10,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:54:10,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:54:10,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:10,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:10,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:54:10,384 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-07-11 17:54:10,384 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1dfe5135[Count = 0] remaining members to acquire global barrier 2023-07-11 17:54:10,384 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-07-11 17:54:10,384 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:10,389 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:10,389 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:10,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:10,389 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-07-11 17:54:10,389 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-07-11 17:54:10,389 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase9.apache.org,45839,1689097999112' in zk 2023-07-11 17:54:10,389 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:10,389 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 17:54:10,390 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-07-11 17:54:10,390 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:10,390 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:54:10,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:10,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:54:10,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:54:10,390 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-07-11 17:54:10,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:54:10,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:54:10,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:10,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:10,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:54:10,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:10,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:10,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase9.apache.org,45839,1689097999112': 2023-07-11 17:54:10,392 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-07-11 17:54:10,392 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-07-11 17:54:10,392 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 17:54:10,392 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 17:54:10,392 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:10,392 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 17:54:10,394 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:10,394 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:10,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:10,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:54:10,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:54:10,394 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:10,394 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:54:10,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:10,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:54:10,394 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:54:10,394 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:10,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:10,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:54:10,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:54:10,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:10,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:10,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:10,395 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:10,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:54:10,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:10,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:10,398 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:10,398 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:10,398 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:54:10,398 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:10,398 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:54:10,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:54:10,398 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:54:10,398 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-07-11 17:54:10,399 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 17:54:10,398 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:10,398 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:54:10,399 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:10,399 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:10,399 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:10,399 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:54:10,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:54:10,399 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-07-11 17:54:10,399 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 17:54:10,499 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 17:54:10,500 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 17:54:10,504 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 17:54:10,505 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-07-11 17:54:10,506 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:10,506 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-07-11 17:54:10,506 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:54:10,506 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-07-11 17:54:10,506 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-07-11 17:54:10,506 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:10,506 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:10,507 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:10,507 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:54:10,508 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:54:10,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:54:10,508 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:10,508 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 17:54:10,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:10,508 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:10,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 17:54:10,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:10,509 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:10,509 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-07-11 17:54:10,509 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:10,509 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-07-11 17:54:10,509 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:54:10,509 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-07-11 17:54:10,509 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 17:54:10,509 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 17:54:10,509 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1689098047452.86ac0fab4b9c1edad19043fde0c2391a. 2023-07-11 17:54:10,510 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1689098047452.86ac0fab4b9c1edad19043fde0c2391a. started... 2023-07-11 17:54:10,510 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 86ac0fab4b9c1edad19043fde0c2391a 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-11 17:54:10,923 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512019e4cc8a49fc348408b79d58fa933cc12 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512019e4cc8a49fc348408b79d58fa933cc12 2023-07-11 17:54:11,329 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyPolicy/86ac0fab4b9c1edad19043fde0c2391a/.tmp/family1/9949c8f127f14fd1819ea176967f37a9 2023-07-11 17:54:11,334 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyPolicy/86ac0fab4b9c1edad19043fde0c2391a/.tmp/family1/9949c8f127f14fd1819ea176967f37a9 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyPolicy/86ac0fab4b9c1edad19043fde0c2391a/family1/9949c8f127f14fd1819ea176967f37a9 2023-07-11 17:54:11,338 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyPolicy/86ac0fab4b9c1edad19043fde0c2391a/family1/9949c8f127f14fd1819ea176967f37a9, entries=1, sequenceid=13, filesize=4.9 K 2023-07-11 17:54:11,339 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 86ac0fab4b9c1edad19043fde0c2391a in 829ms, sequenceid=13, compaction requested=true 2023-07-11 17:54:11,339 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 86ac0fab4b9c1edad19043fde0c2391a: 2023-07-11 17:54:11,339 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1689098047452.86ac0fab4b9c1edad19043fde0c2391a. 2023-07-11 17:54:11,339 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 17:54:11,339 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 17:54:11,339 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:11,339 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-07-11 17:54:11,339 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-07-11 17:54:11,340 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:11,340 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:11,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:11,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:54:11,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:54:11,341 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:11,341 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 17:54:11,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:54:11,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:54:11,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:11,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:11,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:54:11,342 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-07-11 17:54:11,342 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2c897378[Count = 0] remaining members to acquire global barrier 2023-07-11 17:54:11,342 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-07-11 17:54:11,342 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:11,343 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:11,343 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:11,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:11,343 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-07-11 17:54:11,343 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-07-11 17:54:11,343 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase9.apache.org,45839,1689097999112' in zk 2023-07-11 17:54:11,343 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:11,343 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 17:54:11,345 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:11,345 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-07-11 17:54:11,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:11,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:54:11,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:54:11,345 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:54:11,345 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-07-11 17:54:11,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:54:11,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:54:11,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:11,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:11,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:54:11,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:11,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:11,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase9.apache.org,45839,1689097999112': 2023-07-11 17:54:11,348 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-07-11 17:54:11,348 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-07-11 17:54:11,348 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 17:54:11,348 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 17:54:11,348 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:11,348 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 17:54:11,349 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:11,349 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:11,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:11,349 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:11,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:54:11,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:54:11,349 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:54:11,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:11,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:54:11,350 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:11,350 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:54:11,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:54:11,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:11,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:54:11,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:11,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:11,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:11,351 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:11,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:54:11,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:11,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:11,353 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:54:11,353 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:11,353 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:54:11,353 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:11,353 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-07-11 17:54:11,353 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 17:54:11,353 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:54:11,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:54:11,353 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:54:11,353 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:11,354 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:11,354 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:11,354 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:11,354 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:11,354 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-07-11 17:54:11,354 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 17:54:11,354 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:54:11,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:54:11,454 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 17:54:11,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 17:54:11,459 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 17:54:11,460 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-07-11 17:54:11,460 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:11,460 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-07-11 17:54:11,460 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:54:11,460 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-07-11 17:54:11,460 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-07-11 17:54:11,461 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:11,461 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:11,462 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:11,462 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:54:11,462 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:54:11,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:54:11,462 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:11,462 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 17:54:11,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:11,463 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:11,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 17:54:11,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:11,463 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:11,463 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-07-11 17:54:11,463 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:11,463 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-07-11 17:54:11,463 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:54:11,463 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-07-11 17:54:11,464 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 17:54:11,464 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 17:54:11,464 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1689098047452.86ac0fab4b9c1edad19043fde0c2391a. 2023-07-11 17:54:11,464 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1689098047452.86ac0fab4b9c1edad19043fde0c2391a. started... 2023-07-11 17:54:11,464 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 86ac0fab4b9c1edad19043fde0c2391a 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-11 17:54:11,877 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205fcf4af789c6b4b958643bb8a92b5e34f to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151205fcf4af789c6b4b958643bb8a92b5e34f 2023-07-11 17:54:12,283 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyPolicy/86ac0fab4b9c1edad19043fde0c2391a/.tmp/family1/328f1ab7440c4674abc1aa5f06855262 2023-07-11 17:54:12,288 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyPolicy/86ac0fab4b9c1edad19043fde0c2391a/.tmp/family1/328f1ab7440c4674abc1aa5f06855262 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyPolicy/86ac0fab4b9c1edad19043fde0c2391a/family1/328f1ab7440c4674abc1aa5f06855262 2023-07-11 17:54:12,292 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyPolicy/86ac0fab4b9c1edad19043fde0c2391a/family1/328f1ab7440c4674abc1aa5f06855262, entries=1, sequenceid=17, filesize=4.9 K 2023-07-11 17:54:12,293 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 86ac0fab4b9c1edad19043fde0c2391a in 829ms, sequenceid=17, compaction requested=true 2023-07-11 17:54:12,293 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 86ac0fab4b9c1edad19043fde0c2391a: 2023-07-11 17:54:12,293 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1689098047452.86ac0fab4b9c1edad19043fde0c2391a. 2023-07-11 17:54:12,293 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 17:54:12,293 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 17:54:12,293 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:12,293 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-07-11 17:54:12,293 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-07-11 17:54:12,295 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:12,295 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:12,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:12,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:54:12,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:54:12,295 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:12,295 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 17:54:12,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:54:12,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:54:12,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:12,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:12,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:54:12,296 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-07-11 17:54:12,296 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1db8659a[Count = 0] remaining members to acquire global barrier 2023-07-11 17:54:12,296 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-07-11 17:54:12,296 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:12,297 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:12,297 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:12,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:12,297 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-07-11 17:54:12,297 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-07-11 17:54:12,297 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase9.apache.org,45839,1689097999112' in zk 2023-07-11 17:54:12,297 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:12,297 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 17:54:12,298 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:12,298 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-07-11 17:54:12,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:12,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:54:12,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:54:12,299 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:54:12,299 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-07-11 17:54:12,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:54:12,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:54:12,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:12,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:12,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:54:12,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:12,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:12,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase9.apache.org,45839,1689097999112': 2023-07-11 17:54:12,301 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-07-11 17:54:12,301 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-07-11 17:54:12,301 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 17:54:12,301 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 17:54:12,301 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:12,301 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 17:54:12,303 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:12,303 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:12,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:12,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:54:12,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:54:12,303 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:12,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:12,303 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:54:12,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:54:12,304 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:54:12,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:54:12,304 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:12,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:12,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:12,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:54:12,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:12,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:12,305 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:12,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:54:12,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:12,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:12,306 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:12,306 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:54:12,307 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:12,307 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:54:12,307 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:54:12,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:54:12,307 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-07-11 17:54:12,307 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 17:54:12,307 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:12,307 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:54:12,307 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:12,307 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:12,307 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:12,307 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:54:12,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:54:12,307 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-07-11 17:54:12,307 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:12,307 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 17:54:12,407 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 17:54:12,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 17:54:12,412 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 17:54:12,414 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-07-11 17:54:12,414 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:12,414 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-07-11 17:54:12,414 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:54:12,414 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-07-11 17:54:12,414 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-07-11 17:54:12,414 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:12,414 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:12,415 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:12,415 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:54:12,416 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:54:12,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:54:12,416 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:12,416 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 17:54:12,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:12,416 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:12,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 17:54:12,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:12,417 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:12,417 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-07-11 17:54:12,417 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:12,417 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-07-11 17:54:12,417 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:54:12,417 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-07-11 17:54:12,417 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 17:54:12,417 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 17:54:12,417 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1689098047452.86ac0fab4b9c1edad19043fde0c2391a. 2023-07-11 17:54:12,417 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1689098047452.86ac0fab4b9c1edad19043fde0c2391a. started... 2023-07-11 17:54:12,417 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 86ac0fab4b9c1edad19043fde0c2391a 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-11 17:54:12,830 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015122823310cf46d90469c94619e7e53c153b3 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015122823310cf46d90469c94619e7e53c153b3 2023-07-11 17:54:13,236 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyPolicy/86ac0fab4b9c1edad19043fde0c2391a/.tmp/family1/e9225487e0c64e26ab0b1e94bf1e1c20 2023-07-11 17:54:13,240 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyPolicy/86ac0fab4b9c1edad19043fde0c2391a/.tmp/family1/e9225487e0c64e26ab0b1e94bf1e1c20 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyPolicy/86ac0fab4b9c1edad19043fde0c2391a/family1/e9225487e0c64e26ab0b1e94bf1e1c20 2023-07-11 17:54:13,244 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyPolicy/86ac0fab4b9c1edad19043fde0c2391a/family1/e9225487e0c64e26ab0b1e94bf1e1c20, entries=1, sequenceid=21, filesize=4.9 K 2023-07-11 17:54:13,245 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 86ac0fab4b9c1edad19043fde0c2391a in 828ms, sequenceid=21, compaction requested=true 2023-07-11 17:54:13,245 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 86ac0fab4b9c1edad19043fde0c2391a: 2023-07-11 17:54:13,245 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1689098047452.86ac0fab4b9c1edad19043fde0c2391a. 2023-07-11 17:54:13,245 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 17:54:13,245 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 17:54:13,245 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:13,246 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-07-11 17:54:13,246 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-07-11 17:54:13,249 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:13,249 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:13,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:13,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:54:13,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:54:13,249 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:13,249 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 17:54:13,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:54:13,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:54:13,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:13,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:13,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:54:13,251 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-07-11 17:54:13,251 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@664a93b[Count = 0] remaining members to acquire global barrier 2023-07-11 17:54:13,251 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-07-11 17:54:13,251 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:13,252 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:13,252 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:13,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:13,252 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-07-11 17:54:13,252 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-07-11 17:54:13,252 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase9.apache.org,45839,1689097999112' in zk 2023-07-11 17:54:13,252 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:13,252 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 17:54:13,253 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-07-11 17:54:13,253 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:13,253 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:54:13,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:13,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:54:13,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:54:13,253 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-07-11 17:54:13,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:54:13,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:54:13,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:13,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:13,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:54:13,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:13,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:13,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase9.apache.org,45839,1689097999112': 2023-07-11 17:54:13,256 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-07-11 17:54:13,256 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-07-11 17:54:13,256 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 17:54:13,256 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 17:54:13,256 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:13,256 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 17:54:13,262 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:13,262 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:13,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:13,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:54:13,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:54:13,262 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:13,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:13,262 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:54:13,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:54:13,262 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:13,262 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:54:13,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:54:13,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:13,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:13,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:54:13,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:13,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:13,263 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:13,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:54:13,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:13,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:13,265 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:13,265 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:13,265 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:13,266 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:13,266 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:13,266 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:54:13,265 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:54:13,266 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-07-11 17:54:13,266 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:54:13,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:54:13,266 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-07-11 17:54:13,266 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 17:54:13,266 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:13,266 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:54:13,266 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:13,266 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:54:13,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:54:13,266 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-07-11 17:54:13,266 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 17:54:13,366 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 17:54:13,367 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 17:54:13,372 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 17:54:13,373 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-07-11 17:54:13,373 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:13,373 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-07-11 17:54:13,373 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:54:13,373 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-07-11 17:54:13,373 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-07-11 17:54:13,374 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:13,374 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:13,375 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:13,375 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:54:13,375 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:54:13,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:54:13,375 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:13,375 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 17:54:13,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:13,376 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:13,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 17:54:13,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:13,376 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:13,376 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-07-11 17:54:13,376 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:13,376 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-07-11 17:54:13,376 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:54:13,376 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-07-11 17:54:13,376 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 17:54:13,377 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 17:54:13,377 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1689098047452.86ac0fab4b9c1edad19043fde0c2391a. 2023-07-11 17:54:13,377 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1689098047452.86ac0fab4b9c1edad19043fde0c2391a. started... 2023-07-11 17:54:13,377 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 86ac0fab4b9c1edad19043fde0c2391a 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-11 17:54:13,790 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231cc99c7a81d354513bb7d7e08d1ae24d7 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151231cc99c7a81d354513bb7d7e08d1ae24d7 2023-07-11 17:54:14,196 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyPolicy/86ac0fab4b9c1edad19043fde0c2391a/.tmp/family1/c160029da9b54aeabdd5fdaba162a30d 2023-07-11 17:54:14,201 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyPolicy/86ac0fab4b9c1edad19043fde0c2391a/.tmp/family1/c160029da9b54aeabdd5fdaba162a30d as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyPolicy/86ac0fab4b9c1edad19043fde0c2391a/family1/c160029da9b54aeabdd5fdaba162a30d 2023-07-11 17:54:14,205 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyPolicy/86ac0fab4b9c1edad19043fde0c2391a/family1/c160029da9b54aeabdd5fdaba162a30d, entries=1, sequenceid=25, filesize=4.9 K 2023-07-11 17:54:14,206 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 86ac0fab4b9c1edad19043fde0c2391a in 829ms, sequenceid=25, compaction requested=true 2023-07-11 17:54:14,206 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 86ac0fab4b9c1edad19043fde0c2391a: 2023-07-11 17:54:14,206 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1689098047452.86ac0fab4b9c1edad19043fde0c2391a. 2023-07-11 17:54:14,206 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 17:54:14,206 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 17:54:14,206 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:14,206 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-07-11 17:54:14,206 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-07-11 17:54:14,208 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:14,208 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:14,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:14,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:54:14,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:54:14,208 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:14,208 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 17:54:14,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:54:14,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:54:14,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:14,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:14,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:54:14,209 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-07-11 17:54:14,209 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@69fc373b[Count = 0] remaining members to acquire global barrier 2023-07-11 17:54:14,209 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-07-11 17:54:14,209 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:14,211 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:14,211 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:14,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:14,211 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-07-11 17:54:14,211 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-07-11 17:54:14,211 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase9.apache.org,45839,1689097999112' in zk 2023-07-11 17:54:14,211 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:14,211 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 17:54:14,213 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:14,213 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-07-11 17:54:14,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:14,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:54:14,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:54:14,213 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:54:14,213 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-07-11 17:54:14,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:54:14,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:54:14,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:14,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:14,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:54:14,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:14,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:14,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase9.apache.org,45839,1689097999112': 2023-07-11 17:54:14,215 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-07-11 17:54:14,215 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-07-11 17:54:14,215 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 17:54:14,215 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 17:54:14,215 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:14,215 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 17:54:14,216 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:14,216 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:14,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:14,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:54:14,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:54:14,216 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:14,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:14,216 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:54:14,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:54:14,217 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:14,217 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:54:14,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:54:14,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:14,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:14,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:54:14,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:14,218 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:14,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:14,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:54:14,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:14,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:14,220 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:14,220 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:54:14,220 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:14,220 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:54:14,220 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:54:14,220 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-07-11 17:54:14,220 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-07-11 17:54:14,220 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 17:54:14,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:54:14,220 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:14,220 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:54:14,220 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:14,220 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:14,220 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:14,220 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-07-11 17:54:14,220 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:14,221 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 17:54:14,221 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:54:14,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:54:14,321 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 17:54:14,322 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 17:54:14,326 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 17:54:14,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-07-11 17:54:14,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:14,327 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-07-11 17:54:14,327 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:54:14,327 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-07-11 17:54:14,327 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-07-11 17:54:14,328 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:14,328 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:14,334 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:54:14,334 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:14,334 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:54:14,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:54:14,334 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:14,334 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 17:54:14,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:14,334 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:14,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 17:54:14,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:14,335 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:14,335 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-07-11 17:54:14,335 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:14,335 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-07-11 17:54:14,335 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:54:14,335 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-07-11 17:54:14,335 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 17:54:14,335 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 17:54:14,335 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1689098047452.86ac0fab4b9c1edad19043fde0c2391a. 2023-07-11 17:54:14,335 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1689098047452.86ac0fab4b9c1edad19043fde0c2391a. started... 2023-07-11 17:54:14,335 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 86ac0fab4b9c1edad19043fde0c2391a 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-11 17:54:14,748 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010160db19c91033449cb9f9d6903ba96f2a to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2016010160db19c91033449cb9f9d6903ba96f2a 2023-07-11 17:54:15,154 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyPolicy/86ac0fab4b9c1edad19043fde0c2391a/.tmp/family1/d3e9afcce5924cda8e818e755be138aa 2023-07-11 17:54:15,159 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyPolicy/86ac0fab4b9c1edad19043fde0c2391a/.tmp/family1/d3e9afcce5924cda8e818e755be138aa as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyPolicy/86ac0fab4b9c1edad19043fde0c2391a/family1/d3e9afcce5924cda8e818e755be138aa 2023-07-11 17:54:15,163 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyPolicy/86ac0fab4b9c1edad19043fde0c2391a/family1/d3e9afcce5924cda8e818e755be138aa, entries=1, sequenceid=29, filesize=4.9 K 2023-07-11 17:54:15,164 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 86ac0fab4b9c1edad19043fde0c2391a in 829ms, sequenceid=29, compaction requested=true 2023-07-11 17:54:15,164 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 86ac0fab4b9c1edad19043fde0c2391a: 2023-07-11 17:54:15,164 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1689098047452.86ac0fab4b9c1edad19043fde0c2391a. 2023-07-11 17:54:15,165 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 17:54:15,165 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 17:54:15,165 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:15,165 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-07-11 17:54:15,165 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-07-11 17:54:15,166 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:15,166 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:15,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:15,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:54:15,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:54:15,166 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:15,167 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 17:54:15,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:54:15,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:54:15,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:15,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:15,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:54:15,168 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-07-11 17:54:15,168 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@e099bcf[Count = 0] remaining members to acquire global barrier 2023-07-11 17:54:15,168 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-07-11 17:54:15,168 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:15,169 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:15,169 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:15,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:15,169 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-07-11 17:54:15,169 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:15,169 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 17:54:15,169 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-07-11 17:54:15,169 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase9.apache.org,45839,1689097999112' in zk 2023-07-11 17:54:15,171 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:15,171 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-07-11 17:54:15,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:15,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:54:15,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:54:15,171 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:54:15,171 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-07-11 17:54:15,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:54:15,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:54:15,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:15,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:15,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:54:15,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:15,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:15,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase9.apache.org,45839,1689097999112': 2023-07-11 17:54:15,173 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-07-11 17:54:15,173 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-07-11 17:54:15,173 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 17:54:15,173 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 17:54:15,173 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:15,173 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 17:54:15,175 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:15,175 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:15,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:15,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:54:15,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:54:15,175 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:15,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:15,175 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:54:15,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:54:15,176 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:54:15,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:54:15,176 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:15,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:15,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:15,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:54:15,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:15,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:15,177 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:15,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:54:15,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:15,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:15,179 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:15,179 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:54:15,179 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:54:15,179 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:15,179 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:54:15,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:54:15,179 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:54:15,179 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-07-11 17:54:15,180 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 17:54:15,179 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:15,180 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:15,180 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:15,180 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:15,180 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:54:15,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:54:15,180 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:15,180 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-07-11 17:54:15,180 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 17:54:15,280 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 17:54:15,281 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 17:54:15,285 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 17:54:15,287 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-07-11 17:54:15,287 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:15,287 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-07-11 17:54:15,287 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:54:15,287 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-07-11 17:54:15,287 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-07-11 17:54:15,288 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:15,288 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:15,291 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:54:15,291 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:15,291 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:54:15,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:54:15,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:15,292 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:15,292 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 17:54:15,292 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:15,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 17:54:15,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:15,292 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:15,292 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-07-11 17:54:15,292 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:15,293 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-07-11 17:54:15,293 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:54:15,293 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-07-11 17:54:15,293 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 17:54:15,293 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 17:54:15,293 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1689098047452.86ac0fab4b9c1edad19043fde0c2391a. 2023-07-11 17:54:15,293 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1689098047452.86ac0fab4b9c1edad19043fde0c2391a. started... 2023-07-11 17:54:15,293 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 86ac0fab4b9c1edad19043fde0c2391a 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-11 17:54:15,306 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601038d6beef766f54eabbdff153724f1503a to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201601038d6beef766f54eabbdff153724f1503a 2023-07-11 17:54:15,711 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyPolicy/86ac0fab4b9c1edad19043fde0c2391a/.tmp/family1/ab3b80697243419581788df216ef85cb 2023-07-11 17:54:15,716 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyPolicy/86ac0fab4b9c1edad19043fde0c2391a/.tmp/family1/ab3b80697243419581788df216ef85cb as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyPolicy/86ac0fab4b9c1edad19043fde0c2391a/family1/ab3b80697243419581788df216ef85cb 2023-07-11 17:54:15,720 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyPolicy/86ac0fab4b9c1edad19043fde0c2391a/family1/ab3b80697243419581788df216ef85cb, entries=1, sequenceid=33, filesize=4.9 K 2023-07-11 17:54:15,720 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 86ac0fab4b9c1edad19043fde0c2391a in 427ms, sequenceid=33, compaction requested=true 2023-07-11 17:54:15,721 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 86ac0fab4b9c1edad19043fde0c2391a: 2023-07-11 17:54:15,721 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1689098047452.86ac0fab4b9c1edad19043fde0c2391a. 2023-07-11 17:54:15,721 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 17:54:15,721 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 17:54:15,721 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:15,721 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-07-11 17:54:15,721 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-07-11 17:54:15,722 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:15,722 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:15,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:15,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:54:15,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:54:15,722 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:15,723 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 17:54:15,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:54:15,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:54:15,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:15,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:15,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:54:15,724 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-07-11 17:54:15,724 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@50c3ab21[Count = 0] remaining members to acquire global barrier 2023-07-11 17:54:15,724 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-07-11 17:54:15,724 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:15,725 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:15,725 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:15,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:15,725 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-07-11 17:54:15,725 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-07-11 17:54:15,725 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:15,725 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 17:54:15,725 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase9.apache.org,45839,1689097999112' in zk 2023-07-11 17:54:15,728 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-07-11 17:54:15,728 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:15,728 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:54:15,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:15,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:54:15,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:54:15,728 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-07-11 17:54:15,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:54:15,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:54:15,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:15,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:15,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:54:15,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:15,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:15,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase9.apache.org,45839,1689097999112': 2023-07-11 17:54:15,730 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-07-11 17:54:15,730 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-07-11 17:54:15,730 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 17:54:15,730 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 17:54:15,730 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:15,730 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 17:54:15,731 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:15,731 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:15,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:15,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:54:15,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:54:15,731 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:15,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:15,731 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:54:15,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:54:15,732 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:54:15,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:54:15,732 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:15,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:15,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:15,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:54:15,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:15,733 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:15,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:15,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:54:15,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:15,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:15,735 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:15,735 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:15,735 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:54:15,735 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:15,735 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:54:15,735 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:54:15,735 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:54:15,735 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-07-11 17:54:15,735 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-07-11 17:54:15,736 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 17:54:15,735 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:15,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:54:15,736 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:15,736 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:15,736 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:15,736 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-07-11 17:54:15,736 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 17:54:15,736 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:54:15,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:54:15,836 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 17:54:15,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 17:54:15,841 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 17:54:15,842 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-07-11 17:54:15,842 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:15,843 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-07-11 17:54:15,843 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:54:15,843 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-07-11 17:54:15,843 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-07-11 17:54:15,843 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:15,843 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:15,844 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:15,844 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:54:15,844 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:54:15,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:54:15,844 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:15,844 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 17:54:15,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:15,845 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:15,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 17:54:15,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:15,845 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:15,845 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-07-11 17:54:15,845 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:15,845 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-07-11 17:54:15,845 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:54:15,845 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-07-11 17:54:15,846 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 17:54:15,846 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 17:54:15,846 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1689098047452.86ac0fab4b9c1edad19043fde0c2391a. 2023-07-11 17:54:15,846 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1689098047452.86ac0fab4b9c1edad19043fde0c2391a. started... 2023-07-11 17:54:15,846 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 86ac0fab4b9c1edad19043fde0c2391a 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-11 17:54:16,259 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907fd23e920db914b2494250712f72c95c2 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20150907fd23e920db914b2494250712f72c95c2 2023-07-11 17:54:16,664 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyPolicy/86ac0fab4b9c1edad19043fde0c2391a/.tmp/family1/54bc3f32b68a41a4b6c4016fcbc37708 2023-07-11 17:54:16,669 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyPolicy/86ac0fab4b9c1edad19043fde0c2391a/.tmp/family1/54bc3f32b68a41a4b6c4016fcbc37708 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyPolicy/86ac0fab4b9c1edad19043fde0c2391a/family1/54bc3f32b68a41a4b6c4016fcbc37708 2023-07-11 17:54:16,674 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyPolicy/86ac0fab4b9c1edad19043fde0c2391a/family1/54bc3f32b68a41a4b6c4016fcbc37708, entries=1, sequenceid=37, filesize=4.9 K 2023-07-11 17:54:16,675 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 86ac0fab4b9c1edad19043fde0c2391a in 829ms, sequenceid=37, compaction requested=true 2023-07-11 17:54:16,675 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 86ac0fab4b9c1edad19043fde0c2391a: 2023-07-11 17:54:16,675 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1689098047452.86ac0fab4b9c1edad19043fde0c2391a. 2023-07-11 17:54:16,675 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 17:54:16,675 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 17:54:16,675 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:16,675 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-07-11 17:54:16,675 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-07-11 17:54:16,677 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:16,677 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:16,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:16,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:54:16,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:54:16,678 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:16,678 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 17:54:16,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:54:16,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:54:16,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:16,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:16,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:54:16,679 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-07-11 17:54:16,679 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-07-11 17:54:16,679 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@734ded73[Count = 0] remaining members to acquire global barrier 2023-07-11 17:54:16,679 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:16,680 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:16,680 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:16,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:16,680 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-07-11 17:54:16,681 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-07-11 17:54:16,681 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase9.apache.org,45839,1689097999112' in zk 2023-07-11 17:54:16,681 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:16,681 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 17:54:16,682 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-07-11 17:54:16,682 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:54:16,682 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:16,682 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-07-11 17:54:16,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:16,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:54:16,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:54:16,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:54:16,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:54:16,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:16,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:16,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:54:16,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:16,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:16,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase9.apache.org,45839,1689097999112': 2023-07-11 17:54:16,684 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-07-11 17:54:16,684 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-07-11 17:54:16,684 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 17:54:16,684 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 17:54:16,684 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:16,684 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 17:54:16,685 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:16,685 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:16,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:16,686 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:16,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:54:16,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:54:16,686 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:54:16,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:16,686 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:16,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:54:16,686 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:54:16,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:54:16,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:16,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:16,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:54:16,687 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:16,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:16,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:16,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:54:16,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:16,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:16,690 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:16,690 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:54:16,690 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:16,690 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:54:16,690 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:54:16,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:54:16,690 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:54:16,690 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-07-11 17:54:16,690 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 17:54:16,690 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:16,690 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-07-11 17:54:16,690 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:16,690 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:16,690 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:16,690 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:16,690 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:54:16,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:54:16,691 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-07-11 17:54:16,691 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 17:54:16,791 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 17:54:16,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 17:54:16,796 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 17:54:16,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-07-11 17:54:16,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:16,798 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-07-11 17:54:16,798 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:54:16,798 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-07-11 17:54:16,798 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-07-11 17:54:16,798 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:16,798 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:16,799 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:16,799 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:54:16,800 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:54:16,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:54:16,800 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:16,800 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 17:54:16,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:16,800 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:16,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 17:54:16,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:16,801 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:16,801 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-07-11 17:54:16,801 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:16,801 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-07-11 17:54:16,801 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:54:16,801 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-07-11 17:54:16,801 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 17:54:16,801 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 17:54:16,801 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1689098047452.86ac0fab4b9c1edad19043fde0c2391a. 2023-07-11 17:54:16,801 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1689098047452.86ac0fab4b9c1edad19043fde0c2391a. started... 2023-07-11 17:54:16,801 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 86ac0fab4b9c1edad19043fde0c2391a 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-11 17:54:17,214 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112081153dcfc0514512a8949bc819732d1a to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015112081153dcfc0514512a8949bc819732d1a 2023-07-11 17:54:17,620 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyPolicy/86ac0fab4b9c1edad19043fde0c2391a/.tmp/family1/f250fddba08f458bbb67191ede192630 2023-07-11 17:54:17,626 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyPolicy/86ac0fab4b9c1edad19043fde0c2391a/.tmp/family1/f250fddba08f458bbb67191ede192630 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyPolicy/86ac0fab4b9c1edad19043fde0c2391a/family1/f250fddba08f458bbb67191ede192630 2023-07-11 17:54:17,630 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyPolicy/86ac0fab4b9c1edad19043fde0c2391a/family1/f250fddba08f458bbb67191ede192630, entries=1, sequenceid=41, filesize=4.9 K 2023-07-11 17:54:17,630 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 86ac0fab4b9c1edad19043fde0c2391a in 829ms, sequenceid=41, compaction requested=true 2023-07-11 17:54:17,630 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 86ac0fab4b9c1edad19043fde0c2391a: 2023-07-11 17:54:17,630 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1689098047452.86ac0fab4b9c1edad19043fde0c2391a. 2023-07-11 17:54:17,631 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 17:54:17,631 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 17:54:17,631 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:17,631 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-07-11 17:54:17,631 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-07-11 17:54:17,633 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:17,633 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:17,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:17,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:54:17,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:54:17,633 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:17,634 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 17:54:17,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:54:17,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:54:17,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:17,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:17,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:54:17,635 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-07-11 17:54:17,635 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7b8049ce[Count = 0] remaining members to acquire global barrier 2023-07-11 17:54:17,635 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-07-11 17:54:17,635 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:17,636 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:17,636 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:17,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:17,636 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-07-11 17:54:17,636 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-07-11 17:54:17,636 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase9.apache.org,45839,1689097999112' in zk 2023-07-11 17:54:17,636 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:17,636 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 17:54:17,637 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:17,637 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-07-11 17:54:17,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:17,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:54:17,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:54:17,637 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:54:17,638 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-07-11 17:54:17,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:54:17,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:54:17,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:17,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:17,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:54:17,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:17,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:17,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase9.apache.org,45839,1689097999112': 2023-07-11 17:54:17,640 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-07-11 17:54:17,640 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-07-11 17:54:17,640 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 17:54:17,640 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 17:54:17,640 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:17,640 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 17:54:17,641 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:17,641 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:17,641 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:17,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:17,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:54:17,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:54:17,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:17,641 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:54:17,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:54:17,642 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:54:17,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:54:17,642 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:17,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:17,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:17,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:54:17,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:17,643 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:17,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:17,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:54:17,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:17,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:17,649 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:17,649 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:54:17,649 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:17,649 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:54:17,649 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:17,649 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:54:17,649 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:54:17,649 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:17,649 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-07-11 17:54:17,649 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 17:54:17,649 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:17,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:54:17,649 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:17,649 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:17,649 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-07-11 17:54:17,649 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:54:17,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:54:17,649 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 17:54:17,750 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 17:54:17,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 17:54:17,752 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=36885] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyPolicy 2023-07-11 17:54:17,754 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] procedure2.ProcedureExecutor(1029): Stored pid=38, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-07-11 17:54:17,755 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=38, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-07-11 17:54:17,756 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-07-11 17:54:17,756 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=38, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1689098657756 2023-07-11 17:54:17,758 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-07-11 17:54:17,760 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyPolicy' and column 'family1' 2023-07-11 17:54:17,760 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-07-11 17:54:17,760 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] zookeeper.ReadOnlyZKClient(139): Connect 0x53508fb3 to 127.0.0.1:50702 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 17:54:17,768 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@375a7581, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 17:54:17,769 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-07-11 17:54:18,208 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103979c1a8041e947888ff205ec8448ff9b to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103979c1a8041e947888ff205ec8448ff9b 2023-07-11 17:54:18,210 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-07-11 17:54:18,223 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 17:54:18,224 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:51288, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 17:54:18,230 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-11 17:54:18,231 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:47230, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-11 17:54:18,239 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/a3de677fad434cbb8bf72f6e182d44ae first=Optional[r3] last=Optional[r6] 2023-07-11 17:54:18,240 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyPolicy,,1689098047452.86ac0fab4b9c1edad19043fde0c2391a., hostname=jenkins-hbase9.apache.org,45839,1689097999112, seqNum=2 for row with hfile group [{family1,hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/a3de677fad434cbb8bf72f6e182d44ae}] 2023-07-11 17:54:18,244 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(763): Validating hfile at hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/a3de677fad434cbb8bf72f6e182d44ae for inclusion in 86ac0fab4b9c1edad19043fde0c2391a/family1 2023-07-11 17:54:18,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-07-11 17:54:18,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(777): Region bounds: first= last= 2023-07-11 17:54:18,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HRegion(2446): Flush status journal for 86ac0fab4b9c1edad19043fde0c2391a: 2023-07-11 17:54:18,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/a3de677fad434cbb8bf72f6e182d44ae to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testMajorCompactionWithWeeklyPolicy__jt9ss3q78capugoab0ip2tuijpd0hd1rk2ebalj2uva6l4qj7ht4c6calmiu4q73/family1/a3de677fad434cbb8bf72f6e182d44ae 2023-07-11 17:54:18,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testMajorCompactionWithWeeklyPolicy__jt9ss3q78capugoab0ip2tuijpd0hd1rk2ebalj2uva6l4qj7ht4c6calmiu4q73/family1/a3de677fad434cbb8bf72f6e182d44ae as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyPolicy/86ac0fab4b9c1edad19043fde0c2391a/family1/9880f8bd9b504ba58cedecf3c8a0e1d1_SeqId_44_ 2023-07-11 17:54:18,250 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(849): Loaded HFile hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testMajorCompactionWithWeeklyPolicy__jt9ss3q78capugoab0ip2tuijpd0hd1rk2ebalj2uva6l4qj7ht4c6calmiu4q73/family1/a3de677fad434cbb8bf72f6e182d44ae into 86ac0fab4b9c1edad19043fde0c2391a/family1 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyPolicy/86ac0fab4b9c1edad19043fde0c2391a/family1/9880f8bd9b504ba58cedecf3c8a0e1d1_SeqId_44_ - updating store file list. 2023-07-11 17:54:18,253 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(882): Loaded HFile hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyPolicy/86ac0fab4b9c1edad19043fde0c2391a/family1/9880f8bd9b504ba58cedecf3c8a0e1d1_SeqId_44_ into 86ac0fab4b9c1edad19043fde0c2391a/family1 2023-07-11 17:54:18,253 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(855): Successfully loaded hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testMajorCompactionWithWeeklyPolicy__jt9ss3q78capugoab0ip2tuijpd0hd1rk2ebalj2uva6l4qj7ht4c6calmiu4q73/family1/a3de677fad434cbb8bf72f6e182d44ae into 86ac0fab4b9c1edad19043fde0c2391a/family1 (new location: hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyPolicy/86ac0fab4b9c1edad19043fde0c2391a/family1/9880f8bd9b504ba58cedecf3c8a0e1d1_SeqId_44_) 2023-07-11 17:54:18,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testMajorCompactionWithWeeklyPolicy__jt9ss3q78capugoab0ip2tuijpd0hd1rk2ebalj2uva6l4qj7ht4c6calmiu4q73/family1/a3de677fad434cbb8bf72f6e182d44ae 2023-07-11 17:54:18,254 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-07-11 17:54:18,257 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51214 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-07-11 17:54:18,257 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(1912): 86ac0fab4b9c1edad19043fde0c2391a/family1 is initiating minor compaction 2023-07-11 17:54:18,257 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@546105dd; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-11 17:54:18,257 INFO [RS:0;jenkins-hbase9:45839-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 86ac0fab4b9c1edad19043fde0c2391a/family1 in testMajorCompactionWithWeeklyPolicy,,1689098047452.86ac0fab4b9c1edad19043fde0c2391a. 2023-07-11 17:54:18,257 INFO [RS:0;jenkins-hbase9:45839-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyPolicy/86ac0fab4b9c1edad19043fde0c2391a/family1/a8a0fd2f95134396a4126b364c315f4b, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyPolicy/86ac0fab4b9c1edad19043fde0c2391a/family1/9949c8f127f14fd1819ea176967f37a9, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyPolicy/86ac0fab4b9c1edad19043fde0c2391a/family1/328f1ab7440c4674abc1aa5f06855262, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyPolicy/86ac0fab4b9c1edad19043fde0c2391a/family1/e9225487e0c64e26ab0b1e94bf1e1c20, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyPolicy/86ac0fab4b9c1edad19043fde0c2391a/family1/c160029da9b54aeabdd5fdaba162a30d, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyPolicy/86ac0fab4b9c1edad19043fde0c2391a/family1/d3e9afcce5924cda8e818e755be138aa, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyPolicy/86ac0fab4b9c1edad19043fde0c2391a/family1/ab3b80697243419581788df216ef85cb, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyPolicy/86ac0fab4b9c1edad19043fde0c2391a/family1/54bc3f32b68a41a4b6c4016fcbc37708, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyPolicy/86ac0fab4b9c1edad19043fde0c2391a/family1/f250fddba08f458bbb67191ede192630, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyPolicy/86ac0fab4b9c1edad19043fde0c2391a/family1/9880f8bd9b504ba58cedecf3c8a0e1d1_SeqId_44_] into tmpdir=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyPolicy/86ac0fab4b9c1edad19043fde0c2391a/.tmp, totalSize=50.0 K 2023-07-11 17:54:18,257 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] compactions.Compactor(207): Compacting a8a0fd2f95134396a4126b364c315f4b, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-07-11 17:54:18,257 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] compactions.Compactor(207): Compacting 9949c8f127f14fd1819ea176967f37a9, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-07-11 17:54:18,257 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] compactions.Compactor(207): Compacting 328f1ab7440c4674abc1aa5f06855262, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-07-11 17:54:18,257 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] compactions.Compactor(207): Compacting e9225487e0c64e26ab0b1e94bf1e1c20, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-07-11 17:54:18,257 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] compactions.Compactor(207): Compacting c160029da9b54aeabdd5fdaba162a30d, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-07-11 17:54:18,257 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] compactions.Compactor(207): Compacting d3e9afcce5924cda8e818e755be138aa, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-07-11 17:54:18,257 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] compactions.Compactor(207): Compacting ab3b80697243419581788df216ef85cb, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-07-11 17:54:18,257 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] compactions.Compactor(207): Compacting 54bc3f32b68a41a4b6c4016fcbc37708, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-07-11 17:54:18,257 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] compactions.Compactor(207): Compacting f250fddba08f458bbb67191ede192630, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-07-11 17:54:18,257 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] compactions.Compactor(207): Compacting 9880f8bd9b504ba58cedecf3c8a0e1d1_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-07-11 17:54:18,259 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-07-11 17:54:18,259 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 17:54:18,261 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015122823310cf46d90469c94619e7e53c153b3 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015122823310cf46d90469c94619e7e53c153b3 2023-07-11 17:54:18,262 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151231cc99c7a81d354513bb7d7e08d1ae24d7 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151231cc99c7a81d354513bb7d7e08d1ae24d7 2023-07-11 17:54:18,263 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2016010160db19c91033449cb9f9d6903ba96f2a to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2016010160db19c91033449cb9f9d6903ba96f2a 2023-07-11 17:54:18,264 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201601038d6beef766f54eabbdff153724f1503a to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201601038d6beef766f54eabbdff153724f1503a 2023-07-11 17:54:18,264 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyPolicy 4 expired mob files are deleted 2023-07-11 17:54:18,264 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-07-11 17:54:18,265 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-07-11 17:54:18,265 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-07-11 17:54:18,265 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-07-11 17:54:18,265 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-07-11 17:54:18,265 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-07-11 17:54:18,265 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-07-11 17:54:18,265 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-07-11 17:54:18,265 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-07-11 17:54:18,292 INFO [RS:0;jenkins-hbase9:45839-shortCompactions-0] throttle.PressureAwareThroughputController(145): 86ac0fab4b9c1edad19043fde0c2391a#family1#compaction#48 average throughput is 0.68 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-11 17:54:19,111 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyPolicy/86ac0fab4b9c1edad19043fde0c2391a/.tmp/family1/3a824497f96d4ae981e7230c67306568 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyPolicy/86ac0fab4b9c1edad19043fde0c2391a/family1/3a824497f96d4ae981e7230c67306568 2023-07-11 17:54:19,116 INFO [RS:0;jenkins-hbase9:45839-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 86ac0fab4b9c1edad19043fde0c2391a/family1 of 86ac0fab4b9c1edad19043fde0c2391a into 3a824497f96d4ae981e7230c67306568(size=6.6 K), total size for store is 171.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-11 17:54:19,116 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 86ac0fab4b9c1edad19043fde0c2391a: 2023-07-11 17:54:19,117 INFO [RS:0;jenkins-hbase9:45839-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyPolicy,,1689098047452.86ac0fab4b9c1edad19043fde0c2391a., storeName=family1, fileCount=10, fileSize=50.0 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.5 K), priority=2, time=1689098058257; duration=0sec 2023-07-11 17:54:19,117 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-11 17:54:19,124 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512055f934256f370496488b365ecab4fad58 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512055f934256f370496488b365ecab4fad58 2023-07-11 17:54:19,125 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-07-11 17:54:19,146 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyPolicy/86ac0fab4b9c1edad19043fde0c2391a/family1/a8a0fd2f95134396a4126b364c315f4b, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyPolicy/86ac0fab4b9c1edad19043fde0c2391a/family1/9949c8f127f14fd1819ea176967f37a9, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyPolicy/86ac0fab4b9c1edad19043fde0c2391a/family1/328f1ab7440c4674abc1aa5f06855262, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyPolicy/86ac0fab4b9c1edad19043fde0c2391a/family1/e9225487e0c64e26ab0b1e94bf1e1c20, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyPolicy/86ac0fab4b9c1edad19043fde0c2391a/family1/c160029da9b54aeabdd5fdaba162a30d, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyPolicy/86ac0fab4b9c1edad19043fde0c2391a/family1/d3e9afcce5924cda8e818e755be138aa, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyPolicy/86ac0fab4b9c1edad19043fde0c2391a/family1/ab3b80697243419581788df216ef85cb, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyPolicy/86ac0fab4b9c1edad19043fde0c2391a/family1/54bc3f32b68a41a4b6c4016fcbc37708, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyPolicy/86ac0fab4b9c1edad19043fde0c2391a/family1/f250fddba08f458bbb67191ede192630, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyPolicy/86ac0fab4b9c1edad19043fde0c2391a/family1/9880f8bd9b504ba58cedecf3c8a0e1d1_SeqId_44_] to archive 2023-07-11 17:54:19,147 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 17:54:19,149 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyPolicy/86ac0fab4b9c1edad19043fde0c2391a/family1/a8a0fd2f95134396a4126b364c315f4b to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionWithWeeklyPolicy/86ac0fab4b9c1edad19043fde0c2391a/family1/a8a0fd2f95134396a4126b364c315f4b 2023-07-11 17:54:19,150 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyPolicy/86ac0fab4b9c1edad19043fde0c2391a/family1/9949c8f127f14fd1819ea176967f37a9 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionWithWeeklyPolicy/86ac0fab4b9c1edad19043fde0c2391a/family1/9949c8f127f14fd1819ea176967f37a9 2023-07-11 17:54:19,151 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyPolicy/86ac0fab4b9c1edad19043fde0c2391a/family1/328f1ab7440c4674abc1aa5f06855262 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionWithWeeklyPolicy/86ac0fab4b9c1edad19043fde0c2391a/family1/328f1ab7440c4674abc1aa5f06855262 2023-07-11 17:54:19,153 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyPolicy/86ac0fab4b9c1edad19043fde0c2391a/family1/e9225487e0c64e26ab0b1e94bf1e1c20 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionWithWeeklyPolicy/86ac0fab4b9c1edad19043fde0c2391a/family1/e9225487e0c64e26ab0b1e94bf1e1c20 2023-07-11 17:54:19,154 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyPolicy/86ac0fab4b9c1edad19043fde0c2391a/family1/c160029da9b54aeabdd5fdaba162a30d to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionWithWeeklyPolicy/86ac0fab4b9c1edad19043fde0c2391a/family1/c160029da9b54aeabdd5fdaba162a30d 2023-07-11 17:54:19,156 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyPolicy/86ac0fab4b9c1edad19043fde0c2391a/family1/d3e9afcce5924cda8e818e755be138aa to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionWithWeeklyPolicy/86ac0fab4b9c1edad19043fde0c2391a/family1/d3e9afcce5924cda8e818e755be138aa 2023-07-11 17:54:19,157 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyPolicy/86ac0fab4b9c1edad19043fde0c2391a/family1/ab3b80697243419581788df216ef85cb to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionWithWeeklyPolicy/86ac0fab4b9c1edad19043fde0c2391a/family1/ab3b80697243419581788df216ef85cb 2023-07-11 17:54:19,158 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/107942a2e9234dbf8c59783a1f5b68f7 first=Optional[r00] last=Optional[r2] 2023-07-11 17:54:19,158 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyPolicy,,1689098047452.86ac0fab4b9c1edad19043fde0c2391a., hostname=jenkins-hbase9.apache.org,45839,1689097999112, seqNum=2 for row with hfile group [{family1,hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/107942a2e9234dbf8c59783a1f5b68f7}] 2023-07-11 17:54:19,159 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyPolicy/86ac0fab4b9c1edad19043fde0c2391a/family1/54bc3f32b68a41a4b6c4016fcbc37708 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionWithWeeklyPolicy/86ac0fab4b9c1edad19043fde0c2391a/family1/54bc3f32b68a41a4b6c4016fcbc37708 2023-07-11 17:54:19,160 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyPolicy/86ac0fab4b9c1edad19043fde0c2391a/family1/f250fddba08f458bbb67191ede192630 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionWithWeeklyPolicy/86ac0fab4b9c1edad19043fde0c2391a/family1/f250fddba08f458bbb67191ede192630 2023-07-11 17:54:19,160 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(763): Validating hfile at hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/107942a2e9234dbf8c59783a1f5b68f7 for inclusion in 86ac0fab4b9c1edad19043fde0c2391a/family1 2023-07-11 17:54:19,161 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyPolicy/86ac0fab4b9c1edad19043fde0c2391a/family1/9880f8bd9b504ba58cedecf3c8a0e1d1_SeqId_44_ to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionWithWeeklyPolicy/86ac0fab4b9c1edad19043fde0c2391a/family1/9880f8bd9b504ba58cedecf3c8a0e1d1_SeqId_44_ 2023-07-11 17:54:19,163 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-07-11 17:54:19,163 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(777): Region bounds: first= last= 2023-07-11 17:54:19,163 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HRegion(2446): Flush status journal for 86ac0fab4b9c1edad19043fde0c2391a: 2023-07-11 17:54:19,164 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/107942a2e9234dbf8c59783a1f5b68f7 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testMajorCompactionWithWeeklyPolicy__j1d04ofkm358cnaomgu185h00a2rascms3gltm5gtr4a34bj9n19eo01f3l46liq/family1/107942a2e9234dbf8c59783a1f5b68f7 2023-07-11 17:54:19,166 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testMajorCompactionWithWeeklyPolicy__j1d04ofkm358cnaomgu185h00a2rascms3gltm5gtr4a34bj9n19eo01f3l46liq/family1/107942a2e9234dbf8c59783a1f5b68f7 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyPolicy/86ac0fab4b9c1edad19043fde0c2391a/family1/838ee1f300894c8a96deb33b5a9216be_SeqId_47_ 2023-07-11 17:54:19,166 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(849): Loaded HFile hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testMajorCompactionWithWeeklyPolicy__j1d04ofkm358cnaomgu185h00a2rascms3gltm5gtr4a34bj9n19eo01f3l46liq/family1/107942a2e9234dbf8c59783a1f5b68f7 into 86ac0fab4b9c1edad19043fde0c2391a/family1 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyPolicy/86ac0fab4b9c1edad19043fde0c2391a/family1/838ee1f300894c8a96deb33b5a9216be_SeqId_47_ - updating store file list. 2023-07-11 17:54:19,170 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(882): Loaded HFile hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyPolicy/86ac0fab4b9c1edad19043fde0c2391a/family1/838ee1f300894c8a96deb33b5a9216be_SeqId_47_ into 86ac0fab4b9c1edad19043fde0c2391a/family1 2023-07-11 17:54:19,170 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(855): Successfully loaded hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testMajorCompactionWithWeeklyPolicy__j1d04ofkm358cnaomgu185h00a2rascms3gltm5gtr4a34bj9n19eo01f3l46liq/family1/107942a2e9234dbf8c59783a1f5b68f7 into 86ac0fab4b9c1edad19043fde0c2391a/family1 (new location: hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyPolicy/86ac0fab4b9c1edad19043fde0c2391a/family1/838ee1f300894c8a96deb33b5a9216be_SeqId_47_) 2023-07-11 17:54:19,171 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testMajorCompactionWithWeeklyPolicy__j1d04ofkm358cnaomgu185h00a2rascms3gltm5gtr4a34bj9n19eo01f3l46liq/family1/107942a2e9234dbf8c59783a1f5b68f7 2023-07-11 17:54:19,171 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-07-11 17:54:19,172 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 345120 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-07-11 17:54:19,172 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(1912): 86ac0fab4b9c1edad19043fde0c2391a/family1 is initiating minor compaction (all files) 2023-07-11 17:54:19,172 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@7cc29c15; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-11 17:54:19,172 INFO [RS:0;jenkins-hbase9:45839-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 86ac0fab4b9c1edad19043fde0c2391a/family1 in testMajorCompactionWithWeeklyPolicy,,1689098047452.86ac0fab4b9c1edad19043fde0c2391a. 2023-07-11 17:54:19,172 INFO [RS:0;jenkins-hbase9:45839-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyPolicy/86ac0fab4b9c1edad19043fde0c2391a/family1/60cab8263e274836ac19f8efbbb0e643, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyPolicy/86ac0fab4b9c1edad19043fde0c2391a/family1/3a824497f96d4ae981e7230c67306568, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyPolicy/86ac0fab4b9c1edad19043fde0c2391a/family1/838ee1f300894c8a96deb33b5a9216be_SeqId_47_] into tmpdir=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyPolicy/86ac0fab4b9c1edad19043fde0c2391a/.tmp, totalSize=337.0 K 2023-07-11 17:54:19,173 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] compactions.Compactor(207): Compacting 60cab8263e274836ac19f8efbbb0e643, keycount=1000, bloomtype=ROW, size=165.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878822106 2023-07-11 17:54:19,173 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] compactions.Compactor(207): Compacting 3a824497f96d4ae981e7230c67306568, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621222106 2023-07-11 17:54:19,174 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] compactions.Compactor(207): Compacting 838ee1f300894c8a96deb33b5a9216be_SeqId_47_, keycount=1002, bloomtype=ROW, size=165.4 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878822106 2023-07-11 17:54:19,174 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-07-11 17:54:19,175 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 17:54:19,176 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015113041628bfd469042349c0134278b2b2a66 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015113041628bfd469042349c0134278b2b2a66 2023-07-11 17:54:19,177 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512019e4cc8a49fc348408b79d58fa933cc12 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512019e4cc8a49fc348408b79d58fa933cc12 2023-07-11 17:54:19,179 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151205fcf4af789c6b4b958643bb8a92b5e34f to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151205fcf4af789c6b4b958643bb8a92b5e34f 2023-07-11 17:54:19,179 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyPolicy 3 expired mob files are deleted 2023-07-11 17:54:19,179 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-07-11 17:54:19,179 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-07-11 17:54:19,179 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-07-11 17:54:19,179 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-07-11 17:54:19,181 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=38, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-07-11 17:54:19,182 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=38, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE in 1.4280 sec 2023-07-11 17:54:19,191 INFO [RS:0;jenkins-hbase9:45839-shortCompactions-0] throttle.PressureAwareThroughputController(145): 86ac0fab4b9c1edad19043fde0c2391a#family1#compaction#49 average throughput is 19.33 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-11 17:54:19,276 INFO [Listener at localhost/43271] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyPolicy Thread=260 (was 248) - Thread LEAK? -, OpenFileDescriptor=629 (was 589) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=172 (was 151) - SystemLoadAverage LEAK? -, ProcessCount=170 (was 170), AvailableMemoryMB=8649 (was 8660) 2023-07-11 17:54:19,288 INFO [Listener at localhost/43271] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly Thread=260, OpenFileDescriptor=629, MaxFileDescriptor=60000, SystemLoadAverage=172, ProcessCount=170, AvailableMemoryMB=8649 2023-07-11 17:54:19,290 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-07-11 17:54:19,291 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure2.ProcedureExecutor(1029): Stored pid=39, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:19,293 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_PRE_OPERATION 2023-07-11 17:54:19,293 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly" procId is: 39 2023-07-11 17:54:19,293 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-11 17:54:19,294 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-07-11 17:54:19,295 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/dada713f65e06525f8aa63e933747743 2023-07-11 17:54:19,296 DEBUG [HFileArchiver-9] backup.HFileArchiver(153): Directory hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/dada713f65e06525f8aa63e933747743 empty. 2023-07-11 17:54:19,296 DEBUG [HFileArchiver-9] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/dada713f65e06525f8aa63e933747743 2023-07-11 17:54:19,296 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly regions 2023-07-11 17:54:19,395 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-07-11 17:54:19,596 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-07-11 17:54:19,706 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000001 2023-07-11 17:54:19,707 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(7675): creating {ENCODED => dada713f65e06525f8aa63e933747743, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689098059290.dada713f65e06525f8aa63e933747743.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/.tmp 2023-07-11 17:54:19,898 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-07-11 17:54:20,113 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689098059290.dada713f65e06525f8aa63e933747743.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 17:54:20,113 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1604): Closing dada713f65e06525f8aa63e933747743, disabling compactions & flushes 2023-07-11 17:54:20,113 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689098059290.dada713f65e06525f8aa63e933747743. 2023-07-11 17:54:20,113 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689098059290.dada713f65e06525f8aa63e933747743. 2023-07-11 17:54:20,113 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689098059290.dada713f65e06525f8aa63e933747743. after waiting 0 ms 2023-07-11 17:54:20,113 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689098059290.dada713f65e06525f8aa63e933747743. 2023-07-11 17:54:20,113 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689098059290.dada713f65e06525f8aa63e933747743. 2023-07-11 17:54:20,113 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1558): Region close journal for dada713f65e06525f8aa63e933747743: 2023-07-11 17:54:20,117 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_ADD_TO_META 2023-07-11 17:54:20,118 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689098059290.dada713f65e06525f8aa63e933747743.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1689098060117"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689098060117"}]},"ts":"1689098060117"} 2023-07-11 17:54:20,119 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-11 17:54:20,120 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-11 17:54:20,120 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689098060120"}]},"ts":"1689098060120"} 2023-07-11 17:54:20,121 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, state=ENABLING in hbase:meta 2023-07-11 17:54:20,125 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=dada713f65e06525f8aa63e933747743, ASSIGN}] 2023-07-11 17:54:20,126 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=dada713f65e06525f8aa63e933747743, ASSIGN 2023-07-11 17:54:20,127 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=dada713f65e06525f8aa63e933747743, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,45839,1689097999112; forceNewPlan=false, retain=false 2023-07-11 17:54:20,278 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=dada713f65e06525f8aa63e933747743, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:20,278 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689098059290.dada713f65e06525f8aa63e933747743.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1689098060278"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689098060278"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689098060278"}]},"ts":"1689098060278"} 2023-07-11 17:54:20,280 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=41, ppid=40, state=RUNNABLE; OpenRegionProcedure dada713f65e06525f8aa63e933747743, server=jenkins-hbase9.apache.org,45839,1689097999112}] 2023-07-11 17:54:20,399 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-07-11 17:54:20,410 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyPolicy/86ac0fab4b9c1edad19043fde0c2391a/.tmp/family1/564cea27155f486097d49947a2fc91a2 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyPolicy/86ac0fab4b9c1edad19043fde0c2391a/family1/564cea27155f486097d49947a2fc91a2 2023-07-11 17:54:20,415 INFO [RS:0;jenkins-hbase9:45839-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 86ac0fab4b9c1edad19043fde0c2391a/family1 of 86ac0fab4b9c1edad19043fde0c2391a into 564cea27155f486097d49947a2fc91a2(size=166.4 K), total size for store is 166.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-07-11 17:54:20,415 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 86ac0fab4b9c1edad19043fde0c2391a: 2023-07-11 17:54:20,416 INFO [RS:0;jenkins-hbase9:45839-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyPolicy,,1689098047452.86ac0fab4b9c1edad19043fde0c2391a., storeName=family1, fileCount=3, fileSize=337.0 K (165.1 K, 6.6 K, 165.4 K), priority=2, time=1689098059172; duration=1sec 2023-07-11 17:54:20,416 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-11 17:54:20,434 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689098059290.dada713f65e06525f8aa63e933747743. 2023-07-11 17:54:20,434 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => dada713f65e06525f8aa63e933747743, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689098059290.dada713f65e06525f8aa63e933747743.', STARTKEY => '', ENDKEY => ''} 2023-07-11 17:54:20,434 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly dada713f65e06525f8aa63e933747743 2023-07-11 17:54:20,434 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689098059290.dada713f65e06525f8aa63e933747743.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 17:54:20,434 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for dada713f65e06525f8aa63e933747743 2023-07-11 17:54:20,434 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for dada713f65e06525f8aa63e933747743 2023-07-11 17:54:20,435 INFO [StoreOpener-dada713f65e06525f8aa63e933747743-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region dada713f65e06525f8aa63e933747743 2023-07-11 17:54:20,439 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyPolicy/86ac0fab4b9c1edad19043fde0c2391a/family1/60cab8263e274836ac19f8efbbb0e643, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyPolicy/86ac0fab4b9c1edad19043fde0c2391a/family1/3a824497f96d4ae981e7230c67306568, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyPolicy/86ac0fab4b9c1edad19043fde0c2391a/family1/838ee1f300894c8a96deb33b5a9216be_SeqId_47_] to archive 2023-07-11 17:54:20,439 DEBUG [StoreOpener-dada713f65e06525f8aa63e933747743-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/dada713f65e06525f8aa63e933747743/family1 2023-07-11 17:54:20,439 DEBUG [StoreOpener-dada713f65e06525f8aa63e933747743-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/dada713f65e06525f8aa63e933747743/family1 2023-07-11 17:54:20,440 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 17:54:20,440 INFO [StoreOpener-dada713f65e06525f8aa63e933747743-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dada713f65e06525f8aa63e933747743 columnFamilyName family1 2023-07-11 17:54:20,441 INFO [StoreOpener-dada713f65e06525f8aa63e933747743-1] regionserver.HStore(310): Store=dada713f65e06525f8aa63e933747743/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 17:54:20,441 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyPolicy/86ac0fab4b9c1edad19043fde0c2391a/family1/60cab8263e274836ac19f8efbbb0e643 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionWithWeeklyPolicy/86ac0fab4b9c1edad19043fde0c2391a/family1/60cab8263e274836ac19f8efbbb0e643 2023-07-11 17:54:20,442 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/dada713f65e06525f8aa63e933747743 2023-07-11 17:54:20,442 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/dada713f65e06525f8aa63e933747743 2023-07-11 17:54:20,442 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyPolicy/86ac0fab4b9c1edad19043fde0c2391a/family1/3a824497f96d4ae981e7230c67306568 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionWithWeeklyPolicy/86ac0fab4b9c1edad19043fde0c2391a/family1/3a824497f96d4ae981e7230c67306568 2023-07-11 17:54:20,444 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyPolicy/86ac0fab4b9c1edad19043fde0c2391a/family1/838ee1f300894c8a96deb33b5a9216be_SeqId_47_ to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionWithWeeklyPolicy/86ac0fab4b9c1edad19043fde0c2391a/family1/838ee1f300894c8a96deb33b5a9216be_SeqId_47_ 2023-07-11 17:54:20,444 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for dada713f65e06525f8aa63e933747743 2023-07-11 17:54:20,446 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/dada713f65e06525f8aa63e933747743/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 17:54:20,446 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened dada713f65e06525f8aa63e933747743; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66285989, jitterRate=-0.01226179301738739}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 17:54:20,446 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for dada713f65e06525f8aa63e933747743: 2023-07-11 17:54:20,447 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689098059290.dada713f65e06525f8aa63e933747743., pid=41, masterSystemTime=1689098060431 2023-07-11 17:54:20,448 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689098059290.dada713f65e06525f8aa63e933747743. 2023-07-11 17:54:20,448 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689098059290.dada713f65e06525f8aa63e933747743. 2023-07-11 17:54:20,449 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=dada713f65e06525f8aa63e933747743, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:20,449 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689098059290.dada713f65e06525f8aa63e933747743.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1689098060449"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689098060449"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689098060449"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689098060449"}]},"ts":"1689098060449"} 2023-07-11 17:54:20,451 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=41, resume processing ppid=40 2023-07-11 17:54:20,452 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=41, ppid=40, state=SUCCESS; OpenRegionProcedure dada713f65e06525f8aa63e933747743, server=jenkins-hbase9.apache.org,45839,1689097999112 in 170 msec 2023-07-11 17:54:20,453 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=39 2023-07-11 17:54:20,453 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=39, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=dada713f65e06525f8aa63e933747743, ASSIGN in 327 msec 2023-07-11 17:54:20,454 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-11 17:54:20,454 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689098060454"}]},"ts":"1689098060454"} 2023-07-11 17:54:20,455 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, state=ENABLED in hbase:meta 2023-07-11 17:54:20,457 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_POST_OPERATION 2023-07-11 17:54:20,458 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=39, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.1670 sec 2023-07-11 17:54:21,400 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-07-11 17:54:21,400 INFO [Listener at localhost/43271] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, procId: 39 completed 2023-07-11 17:54:21,431 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 17:54:21,433 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:21,433 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-07-11 17:54:21,433 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:54:21,433 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-07-11 17:54:21,433 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-07-11 17:54:21,434 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:21,434 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:21,435 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:54:21,435 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:21,435 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:54:21,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:54:21,435 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:21,435 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 17:54:21,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:21,436 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:21,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 17:54:21,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:21,436 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:21,436 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:21,436 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-07-11 17:54:21,436 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:54:21,436 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-07-11 17:54:21,437 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 17:54:21,437 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 17:54:21,437 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689098059290.dada713f65e06525f8aa63e933747743. 2023-07-11 17:54:21,437 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689098059290.dada713f65e06525f8aa63e933747743. started... 2023-07-11 17:54:21,438 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing dada713f65e06525f8aa63e933747743 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-07-11 17:54:21,858 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130f3e80b559e01475d8d5f0b77ae3ddfd3 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151130f3e80b559e01475d8d5f0b77ae3ddfd3 2023-07-11 17:54:22,262 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/dada713f65e06525f8aa63e933747743/.tmp/family1/98d33ab1851c4c4aaad36def709e50ec 2023-07-11 17:54:22,267 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/dada713f65e06525f8aa63e933747743/.tmp/family1/98d33ab1851c4c4aaad36def709e50ec as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/dada713f65e06525f8aa63e933747743/family1/98d33ab1851c4c4aaad36def709e50ec 2023-07-11 17:54:22,270 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/dada713f65e06525f8aa63e933747743/family1/98d33ab1851c4c4aaad36def709e50ec, entries=1000, sequenceid=5, filesize=191.4 K 2023-07-11 17:54:22,271 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for dada713f65e06525f8aa63e933747743 in 833ms, sequenceid=5, compaction requested=false 2023-07-11 17:54:22,271 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-07-11 17:54:22,272 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for dada713f65e06525f8aa63e933747743: 2023-07-11 17:54:22,272 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689098059290.dada713f65e06525f8aa63e933747743. 2023-07-11 17:54:22,272 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 17:54:22,272 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 17:54:22,272 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:22,272 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-07-11 17:54:22,272 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-07-11 17:54:22,274 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:22,274 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:22,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:22,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:54:22,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:54:22,275 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:22,275 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 17:54:22,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:54:22,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:54:22,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:22,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:22,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:54:22,276 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-07-11 17:54:22,276 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@39956292[Count = 0] remaining members to acquire global barrier 2023-07-11 17:54:22,276 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-07-11 17:54:22,276 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:22,277 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:22,277 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:22,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:22,277 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-07-11 17:54:22,278 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-07-11 17:54:22,278 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:22,278 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 17:54:22,278 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase9.apache.org,45839,1689097999112' in zk 2023-07-11 17:54:22,279 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:22,279 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-07-11 17:54:22,279 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:54:22,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:22,279 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-07-11 17:54:22,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:54:22,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:54:22,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:54:22,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:54:22,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:22,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:22,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:54:22,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:22,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:22,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase9.apache.org,45839,1689097999112': 2023-07-11 17:54:22,281 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-07-11 17:54:22,281 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-07-11 17:54:22,281 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 17:54:22,281 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 17:54:22,281 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:22,281 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 17:54:22,283 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:22,283 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:22,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:22,283 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:22,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:54:22,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:54:22,283 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:54:22,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:22,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:54:22,283 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:54:22,283 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:22,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:54:22,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:22,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:22,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:54:22,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:22,284 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:22,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:22,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:54:22,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:22,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:22,288 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:22,288 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:54:22,288 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:22,288 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:54:22,288 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:54:22,288 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-07-11 17:54:22,288 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:22,288 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:54:22,288 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:22,288 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-07-11 17:54:22,288 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 17:54:22,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:54:22,288 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:22,288 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:22,288 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:22,288 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-07-11 17:54:22,288 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:54:22,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:54:22,288 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 17:54:22,389 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 17:54:22,390 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 17:54:22,394 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 17:54:22,395 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-07-11 17:54:22,395 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:22,395 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-07-11 17:54:22,395 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:54:22,395 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-07-11 17:54:22,395 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-07-11 17:54:22,396 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:22,396 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:22,397 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:22,397 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:54:22,397 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:54:22,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:54:22,397 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:22,397 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 17:54:22,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:22,398 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:22,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 17:54:22,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:22,398 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:22,398 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-07-11 17:54:22,398 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:22,398 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-07-11 17:54:22,398 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:54:22,398 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-07-11 17:54:22,399 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 17:54:22,399 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 17:54:22,399 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689098059290.dada713f65e06525f8aa63e933747743. 2023-07-11 17:54:22,399 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689098059290.dada713f65e06525f8aa63e933747743. started... 2023-07-11 17:54:22,399 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing dada713f65e06525f8aa63e933747743 1/1 column families, dataSize=74 B heapSize=408 B 2023-07-11 17:54:22,814 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128dd20db73350044fa83a5d0b21a6d4b06 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151128dd20db73350044fa83a5d0b21a6d4b06 2023-07-11 17:54:23,220 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/dada713f65e06525f8aa63e933747743/.tmp/family1/1ffee809b31e405ea3f9233abe4b9833 2023-07-11 17:54:23,226 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/dada713f65e06525f8aa63e933747743/.tmp/family1/1ffee809b31e405ea3f9233abe4b9833 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/dada713f65e06525f8aa63e933747743/family1/1ffee809b31e405ea3f9233abe4b9833 2023-07-11 17:54:23,230 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/dada713f65e06525f8aa63e933747743/family1/1ffee809b31e405ea3f9233abe4b9833, entries=1, sequenceid=9, filesize=5.0 K 2023-07-11 17:54:23,231 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for dada713f65e06525f8aa63e933747743 in 832ms, sequenceid=9, compaction requested=false 2023-07-11 17:54:23,231 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for dada713f65e06525f8aa63e933747743: 2023-07-11 17:54:23,231 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689098059290.dada713f65e06525f8aa63e933747743. 2023-07-11 17:54:23,231 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 17:54:23,231 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 17:54:23,231 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:23,231 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-07-11 17:54:23,231 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-07-11 17:54:23,235 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:23,235 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:23,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:23,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:54:23,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:54:23,235 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:23,235 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 17:54:23,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:54:23,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:54:23,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:23,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:23,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:54:23,237 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-07-11 17:54:23,237 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@74c25c22[Count = 0] remaining members to acquire global barrier 2023-07-11 17:54:23,237 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-07-11 17:54:23,237 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:23,238 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:23,238 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:23,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:23,238 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-07-11 17:54:23,238 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-07-11 17:54:23,238 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase9.apache.org,45839,1689097999112' in zk 2023-07-11 17:54:23,238 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:23,238 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 17:54:23,239 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:23,239 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-07-11 17:54:23,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:23,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:54:23,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:54:23,239 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:54:23,240 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-07-11 17:54:23,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:54:23,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:54:23,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:23,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:23,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:54:23,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:23,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:23,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase9.apache.org,45839,1689097999112': 2023-07-11 17:54:23,242 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-07-11 17:54:23,242 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-07-11 17:54:23,242 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 17:54:23,242 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 17:54:23,242 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:23,242 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 17:54:23,244 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:23,244 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:54:23,244 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:23,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:23,244 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:23,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:23,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:54:23,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:54:23,244 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:54:23,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:54:23,244 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:23,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:54:23,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:23,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:23,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:54:23,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:23,245 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:23,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:23,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:54:23,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:23,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:23,250 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:23,250 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:23,250 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:23,250 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:23,250 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:23,250 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:54:23,250 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:54:23,250 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:54:23,250 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:54:23,250 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-07-11 17:54:23,250 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 17:54:23,250 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:23,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:54:23,250 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-07-11 17:54:23,250 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:23,250 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-07-11 17:54:23,250 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:54:23,251 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 17:54:23,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:54:23,351 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 17:54:23,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 17:54:23,355 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 17:54:23,357 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-07-11 17:54:23,357 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:23,357 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-07-11 17:54:23,357 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:54:23,357 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-07-11 17:54:23,357 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-07-11 17:54:23,358 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:23,358 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:23,359 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:54:23,359 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:23,359 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:54:23,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:54:23,359 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:23,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:23,359 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 17:54:23,360 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:23,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 17:54:23,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:23,360 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:23,360 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-07-11 17:54:23,360 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:23,360 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-07-11 17:54:23,360 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:54:23,360 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-07-11 17:54:23,361 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 17:54:23,361 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 17:54:23,361 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689098059290.dada713f65e06525f8aa63e933747743. 2023-07-11 17:54:23,361 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689098059290.dada713f65e06525f8aa63e933747743. started... 2023-07-11 17:54:23,361 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing dada713f65e06525f8aa63e933747743 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-11 17:54:23,773 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201eeffd2f30dc64c9cb955ddbf2371707a to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151201eeffd2f30dc64c9cb955ddbf2371707a 2023-07-11 17:54:24,178 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/dada713f65e06525f8aa63e933747743/.tmp/family1/7037e7a970454a3fbb03d377251a0f1b 2023-07-11 17:54:24,183 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/dada713f65e06525f8aa63e933747743/.tmp/family1/7037e7a970454a3fbb03d377251a0f1b as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/dada713f65e06525f8aa63e933747743/family1/7037e7a970454a3fbb03d377251a0f1b 2023-07-11 17:54:24,186 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/dada713f65e06525f8aa63e933747743/family1/7037e7a970454a3fbb03d377251a0f1b, entries=1, sequenceid=13, filesize=5.0 K 2023-07-11 17:54:24,187 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for dada713f65e06525f8aa63e933747743 in 826ms, sequenceid=13, compaction requested=true 2023-07-11 17:54:24,187 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for dada713f65e06525f8aa63e933747743: 2023-07-11 17:54:24,187 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689098059290.dada713f65e06525f8aa63e933747743. 2023-07-11 17:54:24,187 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 17:54:24,188 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 17:54:24,188 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:24,188 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-07-11 17:54:24,188 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-07-11 17:54:24,189 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:24,189 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:24,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:24,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:54:24,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:54:24,189 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:24,189 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 17:54:24,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:54:24,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:54:24,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:24,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:24,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:54:24,191 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-07-11 17:54:24,191 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@68f811bc[Count = 0] remaining members to acquire global barrier 2023-07-11 17:54:24,191 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-07-11 17:54:24,191 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:24,192 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:24,192 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:24,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:24,192 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-07-11 17:54:24,192 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-07-11 17:54:24,192 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase9.apache.org,45839,1689097999112' in zk 2023-07-11 17:54:24,192 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:24,192 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 17:54:24,194 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:24,194 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-07-11 17:54:24,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:24,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:54:24,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:54:24,194 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:54:24,194 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-07-11 17:54:24,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:54:24,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:54:24,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:24,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:24,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:54:24,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:24,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:24,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase9.apache.org,45839,1689097999112': 2023-07-11 17:54:24,197 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-07-11 17:54:24,197 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-07-11 17:54:24,197 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 17:54:24,197 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 17:54:24,197 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:24,197 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 17:54:24,198 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:24,198 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:24,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:24,198 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:24,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:24,198 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:54:24,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:54:24,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:54:24,199 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:54:24,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:54:24,199 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:24,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:54:24,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:24,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:24,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:54:24,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:24,200 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:24,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:24,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:54:24,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:24,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:24,202 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:24,202 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:24,202 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:54:24,202 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:24,202 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:54:24,202 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-07-11 17:54:24,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:54:24,202 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-07-11 17:54:24,202 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 17:54:24,202 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:54:24,202 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:24,202 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:54:24,202 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:24,202 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:54:24,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:54:24,202 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-07-11 17:54:24,203 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 17:54:24,202 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:24,203 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:24,303 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 17:54:24,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 17:54:24,307 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 17:54:24,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-07-11 17:54:24,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:24,309 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-07-11 17:54:24,309 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:54:24,309 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-07-11 17:54:24,309 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-07-11 17:54:24,309 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:24,309 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:24,311 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:24,311 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:54:24,311 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:54:24,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:54:24,311 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:24,311 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 17:54:24,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:24,311 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:24,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 17:54:24,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:24,312 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:24,312 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-07-11 17:54:24,312 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:24,312 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-07-11 17:54:24,312 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:54:24,312 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-07-11 17:54:24,312 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 17:54:24,312 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 17:54:24,312 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689098059290.dada713f65e06525f8aa63e933747743. 2023-07-11 17:54:24,312 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689098059290.dada713f65e06525f8aa63e933747743. started... 2023-07-11 17:54:24,312 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing dada713f65e06525f8aa63e933747743 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-11 17:54:24,725 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120517e434489c524a328d8feeb2751c8275 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015120517e434489c524a328d8feeb2751c8275 2023-07-11 17:54:25,131 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/dada713f65e06525f8aa63e933747743/.tmp/family1/f7d3af560ea049749746dd23da462c88 2023-07-11 17:54:25,136 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/dada713f65e06525f8aa63e933747743/.tmp/family1/f7d3af560ea049749746dd23da462c88 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/dada713f65e06525f8aa63e933747743/family1/f7d3af560ea049749746dd23da462c88 2023-07-11 17:54:25,141 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/dada713f65e06525f8aa63e933747743/family1/f7d3af560ea049749746dd23da462c88, entries=1, sequenceid=17, filesize=5.0 K 2023-07-11 17:54:25,142 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for dada713f65e06525f8aa63e933747743 in 830ms, sequenceid=17, compaction requested=true 2023-07-11 17:54:25,142 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for dada713f65e06525f8aa63e933747743: 2023-07-11 17:54:25,142 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689098059290.dada713f65e06525f8aa63e933747743. 2023-07-11 17:54:25,142 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 17:54:25,142 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 17:54:25,142 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:25,142 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-07-11 17:54:25,142 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-07-11 17:54:25,144 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:25,144 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:25,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:25,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:54:25,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:54:25,144 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:25,144 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 17:54:25,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:54:25,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:54:25,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:25,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:25,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:54:25,145 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-07-11 17:54:25,145 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@11cffb54[Count = 0] remaining members to acquire global barrier 2023-07-11 17:54:25,145 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-07-11 17:54:25,146 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:25,146 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:25,147 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:25,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:25,147 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-07-11 17:54:25,147 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-07-11 17:54:25,147 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase9.apache.org,45839,1689097999112' in zk 2023-07-11 17:54:25,147 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:25,147 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 17:54:25,148 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-07-11 17:54:25,148 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:54:25,148 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:25,148 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-07-11 17:54:25,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:25,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:54:25,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:54:25,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:54:25,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:54:25,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:25,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:25,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:54:25,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:25,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:25,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase9.apache.org,45839,1689097999112': 2023-07-11 17:54:25,150 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-07-11 17:54:25,150 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-07-11 17:54:25,150 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 17:54:25,150 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 17:54:25,150 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:25,150 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 17:54:25,152 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:25,153 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:25,153 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:25,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:25,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:54:25,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:54:25,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:25,153 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:54:25,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:54:25,153 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:54:25,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:54:25,153 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:25,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:25,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:25,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:54:25,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:25,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:25,154 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:25,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:54:25,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:25,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:25,156 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:25,156 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:54:25,156 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:25,156 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:54:25,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:54:25,156 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:54:25,156 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:25,156 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-07-11 17:54:25,156 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 17:54:25,156 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:54:25,156 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:25,156 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:54:25,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:54:25,156 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:25,157 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:25,157 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-07-11 17:54:25,157 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 17:54:25,157 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:25,257 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 17:54:25,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 17:54:25,262 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 17:54:25,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-07-11 17:54:25,264 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:25,264 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-07-11 17:54:25,264 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:54:25,264 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-07-11 17:54:25,264 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-07-11 17:54:25,264 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:25,264 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:25,265 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:25,265 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:54:25,266 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:54:25,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:54:25,266 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:25,266 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 17:54:25,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:25,266 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:25,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 17:54:25,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:25,267 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:25,267 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-07-11 17:54:25,267 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:25,267 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-07-11 17:54:25,267 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:54:25,267 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-07-11 17:54:25,267 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 17:54:25,268 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 17:54:25,268 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689098059290.dada713f65e06525f8aa63e933747743. 2023-07-11 17:54:25,268 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689098059290.dada713f65e06525f8aa63e933747743. started... 2023-07-11 17:54:25,268 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing dada713f65e06525f8aa63e933747743 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-11 17:54:25,684 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228609c7efc8483464fa47b39542d30f192 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151228609c7efc8483464fa47b39542d30f192 2023-07-11 17:54:25,973 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-07-11 17:54:26,090 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/dada713f65e06525f8aa63e933747743/.tmp/family1/ff4f6297422240d7a7a414a749e90a11 2023-07-11 17:54:26,095 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/dada713f65e06525f8aa63e933747743/.tmp/family1/ff4f6297422240d7a7a414a749e90a11 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/dada713f65e06525f8aa63e933747743/family1/ff4f6297422240d7a7a414a749e90a11 2023-07-11 17:54:26,099 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/dada713f65e06525f8aa63e933747743/family1/ff4f6297422240d7a7a414a749e90a11, entries=1, sequenceid=21, filesize=5.0 K 2023-07-11 17:54:26,100 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for dada713f65e06525f8aa63e933747743 in 832ms, sequenceid=21, compaction requested=true 2023-07-11 17:54:26,100 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for dada713f65e06525f8aa63e933747743: 2023-07-11 17:54:26,100 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689098059290.dada713f65e06525f8aa63e933747743. 2023-07-11 17:54:26,100 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 17:54:26,100 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 17:54:26,100 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:26,100 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-07-11 17:54:26,100 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-07-11 17:54:26,109 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:26,110 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:26,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:26,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:54:26,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:54:26,110 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:26,110 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 17:54:26,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:54:26,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:54:26,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:26,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:26,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:54:26,111 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-07-11 17:54:26,111 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3dc8a0d[Count = 0] remaining members to acquire global barrier 2023-07-11 17:54:26,111 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-07-11 17:54:26,111 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:26,112 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:26,112 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:26,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:26,112 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-07-11 17:54:26,112 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-07-11 17:54:26,112 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase9.apache.org,45839,1689097999112' in zk 2023-07-11 17:54:26,112 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:26,113 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 17:54:26,114 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-07-11 17:54:26,114 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:54:26,114 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:26,114 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-07-11 17:54:26,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:26,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:54:26,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:54:26,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:54:26,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:54:26,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:26,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:26,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:54:26,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:26,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:26,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase9.apache.org,45839,1689097999112': 2023-07-11 17:54:26,116 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-07-11 17:54:26,116 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-07-11 17:54:26,116 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 17:54:26,116 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 17:54:26,116 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:26,116 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 17:54:26,117 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:26,117 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:26,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:26,117 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:54:26,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:54:26,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:54:26,117 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:26,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:26,118 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:54:26,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:54:26,118 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:26,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:54:26,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:26,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:26,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:54:26,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:26,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:26,119 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:26,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:54:26,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:26,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:26,122 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:26,122 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:26,122 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:26,122 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:54:26,122 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:26,122 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:54:26,122 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:54:26,122 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-07-11 17:54:26,122 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:54:26,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:54:26,122 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:26,122 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-07-11 17:54:26,123 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 17:54:26,123 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:26,123 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:26,123 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:54:26,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:54:26,123 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-07-11 17:54:26,123 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 17:54:26,223 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 17:54:26,224 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 17:54:26,228 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 17:54:26,230 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-07-11 17:54:26,230 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:26,230 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-07-11 17:54:26,230 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:54:26,230 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-07-11 17:54:26,230 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-07-11 17:54:26,231 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:26,231 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:26,232 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:26,232 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:54:26,232 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:54:26,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:54:26,232 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:26,232 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 17:54:26,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:26,233 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:26,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 17:54:26,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:26,233 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:26,233 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-07-11 17:54:26,233 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:26,233 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-07-11 17:54:26,233 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:54:26,233 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-07-11 17:54:26,234 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 17:54:26,234 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 17:54:26,234 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689098059290.dada713f65e06525f8aa63e933747743. 2023-07-11 17:54:26,234 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689098059290.dada713f65e06525f8aa63e933747743. started... 2023-07-11 17:54:26,234 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing dada713f65e06525f8aa63e933747743 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-11 17:54:26,646 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512315626a962fac24c829891077d79afe154 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512315626a962fac24c829891077d79afe154 2023-07-11 17:54:27,051 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/dada713f65e06525f8aa63e933747743/.tmp/family1/684f54f0f3d5418198d8e7d4f97a1cd4 2023-07-11 17:54:27,056 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/dada713f65e06525f8aa63e933747743/.tmp/family1/684f54f0f3d5418198d8e7d4f97a1cd4 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/dada713f65e06525f8aa63e933747743/family1/684f54f0f3d5418198d8e7d4f97a1cd4 2023-07-11 17:54:27,060 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/dada713f65e06525f8aa63e933747743/family1/684f54f0f3d5418198d8e7d4f97a1cd4, entries=1, sequenceid=25, filesize=5.0 K 2023-07-11 17:54:27,061 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for dada713f65e06525f8aa63e933747743 in 827ms, sequenceid=25, compaction requested=true 2023-07-11 17:54:27,061 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for dada713f65e06525f8aa63e933747743: 2023-07-11 17:54:27,061 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689098059290.dada713f65e06525f8aa63e933747743. 2023-07-11 17:54:27,061 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 17:54:27,061 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 17:54:27,061 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:27,061 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-07-11 17:54:27,061 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-07-11 17:54:27,062 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:27,062 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:27,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:27,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:54:27,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:54:27,063 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:27,063 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 17:54:27,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:54:27,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:54:27,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:27,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:27,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:54:27,064 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-07-11 17:54:27,064 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6519f518[Count = 0] remaining members to acquire global barrier 2023-07-11 17:54:27,064 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-07-11 17:54:27,064 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:27,065 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:27,065 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:27,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:27,065 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-07-11 17:54:27,065 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-07-11 17:54:27,065 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase9.apache.org,45839,1689097999112' in zk 2023-07-11 17:54:27,065 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:27,065 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 17:54:27,067 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:27,067 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-07-11 17:54:27,067 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:54:27,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:27,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:54:27,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:54:27,068 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-07-11 17:54:27,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:54:27,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:54:27,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:27,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:27,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:54:27,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:27,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:27,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase9.apache.org,45839,1689097999112': 2023-07-11 17:54:27,070 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-07-11 17:54:27,070 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-07-11 17:54:27,070 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 17:54:27,070 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 17:54:27,070 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:27,070 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 17:54:27,071 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:27,071 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:27,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:27,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:54:27,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:54:27,071 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:27,071 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:54:27,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:27,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:54:27,072 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:54:27,072 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:27,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:27,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:54:27,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:54:27,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:27,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:27,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:27,073 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:27,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:54:27,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:27,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:27,075 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:27,075 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:54:27,075 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:27,075 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:54:27,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:54:27,075 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:54:27,075 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-07-11 17:54:27,075 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 17:54:27,075 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:54:27,075 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:27,075 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:27,075 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:27,075 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:27,075 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:27,075 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:54:27,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:54:27,075 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-07-11 17:54:27,075 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 17:54:27,176 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 17:54:27,177 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 17:54:27,180 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 17:54:27,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-07-11 17:54:27,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:27,182 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-07-11 17:54:27,182 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:54:27,182 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-07-11 17:54:27,182 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-07-11 17:54:27,183 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:27,183 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:27,184 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:27,184 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:54:27,184 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:54:27,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:54:27,184 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:27,184 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 17:54:27,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:27,184 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:27,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 17:54:27,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:27,185 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:27,185 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-07-11 17:54:27,185 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:27,185 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-07-11 17:54:27,185 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:54:27,185 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-07-11 17:54:27,185 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 17:54:27,185 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 17:54:27,185 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689098059290.dada713f65e06525f8aa63e933747743. 2023-07-11 17:54:27,185 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689098059290.dada713f65e06525f8aa63e933747743. started... 2023-07-11 17:54:27,186 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing dada713f65e06525f8aa63e933747743 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-11 17:54:27,197 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101742f1b4294ff45d8a24c93df942a4ff0 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160101742f1b4294ff45d8a24c93df942a4ff0 2023-07-11 17:54:27,602 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/dada713f65e06525f8aa63e933747743/.tmp/family1/f70a9936af374bf3ae13c06aeb919525 2023-07-11 17:54:27,606 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/dada713f65e06525f8aa63e933747743/.tmp/family1/f70a9936af374bf3ae13c06aeb919525 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/dada713f65e06525f8aa63e933747743/family1/f70a9936af374bf3ae13c06aeb919525 2023-07-11 17:54:27,610 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/dada713f65e06525f8aa63e933747743/family1/f70a9936af374bf3ae13c06aeb919525, entries=1, sequenceid=29, filesize=5.0 K 2023-07-11 17:54:27,611 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for dada713f65e06525f8aa63e933747743 in 425ms, sequenceid=29, compaction requested=true 2023-07-11 17:54:27,611 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for dada713f65e06525f8aa63e933747743: 2023-07-11 17:54:27,611 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689098059290.dada713f65e06525f8aa63e933747743. 2023-07-11 17:54:27,611 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 17:54:27,611 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 17:54:27,611 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:27,612 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-07-11 17:54:27,612 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-07-11 17:54:27,613 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:27,613 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:27,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:27,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:54:27,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:54:27,613 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:27,613 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 17:54:27,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:54:27,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:54:27,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:27,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:27,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:54:27,615 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-07-11 17:54:27,615 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4d447df6[Count = 0] remaining members to acquire global barrier 2023-07-11 17:54:27,615 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-07-11 17:54:27,615 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:27,616 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:27,616 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:27,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:27,616 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-07-11 17:54:27,616 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-07-11 17:54:27,616 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase9.apache.org,45839,1689097999112' in zk 2023-07-11 17:54:27,616 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:27,616 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 17:54:27,617 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:27,617 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-07-11 17:54:27,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:27,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:54:27,617 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:54:27,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:54:27,617 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-07-11 17:54:27,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:54:27,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:54:27,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:27,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:27,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:54:27,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:27,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:27,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase9.apache.org,45839,1689097999112': 2023-07-11 17:54:27,620 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-07-11 17:54:27,620 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-07-11 17:54:27,620 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 17:54:27,620 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 17:54:27,620 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:27,620 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 17:54:27,624 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:27,624 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:54:27,624 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:27,624 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:27,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:27,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:54:27,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:54:27,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:27,625 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:54:27,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:54:27,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:54:27,625 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:27,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:27,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:27,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:54:27,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:27,626 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:27,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:27,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:54:27,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:27,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:27,628 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:27,628 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:54:27,628 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:27,628 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:54:27,628 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:54:27,628 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:27,628 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:54:27,628 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:27,628 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-07-11 17:54:27,628 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-07-11 17:54:27,628 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 17:54:27,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:54:27,628 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:27,628 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:27,628 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:27,628 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-07-11 17:54:27,628 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:54:27,628 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 17:54:27,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:54:27,729 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 17:54:27,730 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 17:54:27,734 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 17:54:27,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-07-11 17:54:27,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:27,736 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-07-11 17:54:27,736 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:54:27,736 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-07-11 17:54:27,736 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-07-11 17:54:27,737 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:27,737 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:27,738 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:54:27,738 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:27,738 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:54:27,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:54:27,738 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:27,738 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 17:54:27,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:27,739 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:27,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 17:54:27,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:27,739 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:27,739 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-07-11 17:54:27,740 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:27,740 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-07-11 17:54:27,740 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:54:27,740 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-07-11 17:54:27,744 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 17:54:27,744 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 17:54:27,744 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689098059290.dada713f65e06525f8aa63e933747743. 2023-07-11 17:54:27,745 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689098059290.dada713f65e06525f8aa63e933747743. started... 2023-07-11 17:54:27,745 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing dada713f65e06525f8aa63e933747743 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-11 17:54:28,159 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601038afdd9fad5fc4133b498de727a39fd62 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601038afdd9fad5fc4133b498de727a39fd62 2023-07-11 17:54:28,565 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/dada713f65e06525f8aa63e933747743/.tmp/family1/7b15bdf7e1eb463489e82a375051940c 2023-07-11 17:54:28,569 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/dada713f65e06525f8aa63e933747743/.tmp/family1/7b15bdf7e1eb463489e82a375051940c as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/dada713f65e06525f8aa63e933747743/family1/7b15bdf7e1eb463489e82a375051940c 2023-07-11 17:54:28,574 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/dada713f65e06525f8aa63e933747743/family1/7b15bdf7e1eb463489e82a375051940c, entries=1, sequenceid=33, filesize=5.0 K 2023-07-11 17:54:28,575 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for dada713f65e06525f8aa63e933747743 in 830ms, sequenceid=33, compaction requested=true 2023-07-11 17:54:28,575 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for dada713f65e06525f8aa63e933747743: 2023-07-11 17:54:28,575 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689098059290.dada713f65e06525f8aa63e933747743. 2023-07-11 17:54:28,575 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 17:54:28,575 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 17:54:28,575 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:28,575 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-07-11 17:54:28,575 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-07-11 17:54:28,576 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:28,576 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:28,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:28,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:54:28,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:54:28,577 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:28,577 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 17:54:28,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:54:28,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:54:28,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:28,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:28,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:54:28,578 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-07-11 17:54:28,578 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@233f3a51[Count = 0] remaining members to acquire global barrier 2023-07-11 17:54:28,578 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-07-11 17:54:28,578 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:28,580 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:28,580 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:28,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:28,580 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-07-11 17:54:28,580 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-07-11 17:54:28,580 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase9.apache.org,45839,1689097999112' in zk 2023-07-11 17:54:28,580 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:28,581 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 17:54:28,582 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:28,582 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-07-11 17:54:28,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:28,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:54:28,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:54:28,582 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:54:28,582 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-07-11 17:54:28,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:54:28,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:54:28,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:28,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:28,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:54:28,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:28,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:28,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase9.apache.org,45839,1689097999112': 2023-07-11 17:54:28,584 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-07-11 17:54:28,584 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-07-11 17:54:28,584 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 17:54:28,584 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 17:54:28,584 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:28,584 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 17:54:28,585 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:28,585 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:28,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:28,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:54:28,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:54:28,585 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:28,585 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:54:28,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:28,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:54:28,586 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:54:28,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:54:28,586 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:28,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:28,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:28,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:54:28,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:28,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:28,587 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:28,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:54:28,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:28,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:28,589 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:28,589 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:28,589 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:28,589 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:54:28,589 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-07-11 17:54:28,589 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 17:54:28,589 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:54:28,589 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:54:28,589 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:54:28,589 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:28,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:54:28,589 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:28,589 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:28,589 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:28,589 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-07-11 17:54:28,590 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 17:54:28,590 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:54:28,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:54:28,690 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 17:54:28,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 17:54:28,695 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 17:54:28,696 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-07-11 17:54:28,696 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:28,696 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-07-11 17:54:28,696 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:54:28,696 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-07-11 17:54:28,696 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-07-11 17:54:28,697 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:28,697 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:28,701 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:28,701 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:54:28,701 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:54:28,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:54:28,702 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:28,702 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 17:54:28,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:28,702 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:28,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 17:54:28,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:28,702 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:28,702 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-07-11 17:54:28,703 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:28,703 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-07-11 17:54:28,703 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:54:28,703 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-07-11 17:54:28,703 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 17:54:28,703 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 17:54:28,703 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689098059290.dada713f65e06525f8aa63e933747743. 2023-07-11 17:54:28,703 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689098059290.dada713f65e06525f8aa63e933747743. started... 2023-07-11 17:54:28,703 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing dada713f65e06525f8aa63e933747743 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-11 17:54:29,116 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509074dba507bdc3949b2a7f1b5a5cead9272 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201509074dba507bdc3949b2a7f1b5a5cead9272 2023-07-11 17:54:29,523 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/dada713f65e06525f8aa63e933747743/.tmp/family1/d3ef9327d6954886953d8d9cfd875ff8 2023-07-11 17:54:29,528 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/dada713f65e06525f8aa63e933747743/.tmp/family1/d3ef9327d6954886953d8d9cfd875ff8 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/dada713f65e06525f8aa63e933747743/family1/d3ef9327d6954886953d8d9cfd875ff8 2023-07-11 17:54:29,532 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/dada713f65e06525f8aa63e933747743/family1/d3ef9327d6954886953d8d9cfd875ff8, entries=1, sequenceid=37, filesize=5.0 K 2023-07-11 17:54:29,532 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for dada713f65e06525f8aa63e933747743 in 829ms, sequenceid=37, compaction requested=true 2023-07-11 17:54:29,533 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for dada713f65e06525f8aa63e933747743: 2023-07-11 17:54:29,533 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689098059290.dada713f65e06525f8aa63e933747743. 2023-07-11 17:54:29,533 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 17:54:29,533 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 17:54:29,533 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:29,533 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-07-11 17:54:29,533 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-07-11 17:54:29,534 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:29,534 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:29,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:29,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:54:29,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:54:29,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:54:29,535 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:29,535 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 17:54:29,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:54:29,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:29,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:29,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:54:29,536 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-07-11 17:54:29,536 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@44d450d9[Count = 0] remaining members to acquire global barrier 2023-07-11 17:54:29,536 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-07-11 17:54:29,536 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:29,537 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:29,537 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:29,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:29,537 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-07-11 17:54:29,537 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-07-11 17:54:29,537 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase9.apache.org,45839,1689097999112' in zk 2023-07-11 17:54:29,537 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:29,537 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 17:54:29,539 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:29,539 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-07-11 17:54:29,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:29,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:54:29,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:54:29,539 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:54:29,539 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-07-11 17:54:29,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:54:29,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:54:29,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:29,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:29,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:54:29,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:29,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:29,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase9.apache.org,45839,1689097999112': 2023-07-11 17:54:29,541 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-07-11 17:54:29,541 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-07-11 17:54:29,541 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 17:54:29,541 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 17:54:29,541 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:29,541 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 17:54:29,543 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:29,543 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:29,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:29,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:54:29,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:54:29,543 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:29,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:29,543 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:54:29,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:54:29,544 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:29,544 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:54:29,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:54:29,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:29,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:29,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:54:29,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:29,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:29,545 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:29,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:54:29,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:29,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:29,550 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:29,550 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:29,550 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:29,550 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:29,550 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:29,550 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:54:29,550 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:54:29,550 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:29,550 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-07-11 17:54:29,550 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 17:54:29,550 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:29,550 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:54:29,550 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:54:29,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:54:29,551 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-07-11 17:54:29,551 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 17:54:29,551 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:54:29,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:54:29,651 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 17:54:29,652 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 17:54:29,655 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 17:54:29,657 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-07-11 17:54:29,657 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:29,657 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-07-11 17:54:29,657 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:54:29,657 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-07-11 17:54:29,657 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-07-11 17:54:29,657 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:29,657 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:29,659 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:54:29,659 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:29,659 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:54:29,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:54:29,659 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:29,659 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 17:54:29,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:29,659 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:29,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 17:54:29,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:29,660 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:29,660 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-07-11 17:54:29,660 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:29,660 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-07-11 17:54:29,660 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:54:29,660 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-07-11 17:54:29,660 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 17:54:29,660 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 17:54:29,660 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689098059290.dada713f65e06525f8aa63e933747743. 2023-07-11 17:54:29,660 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689098059290.dada713f65e06525f8aa63e933747743. started... 2023-07-11 17:54:29,660 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing dada713f65e06525f8aa63e933747743 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-11 17:54:30,073 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112079d5a026f4024d1890ee4448ac107296 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015112079d5a026f4024d1890ee4448ac107296 2023-07-11 17:54:30,478 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/dada713f65e06525f8aa63e933747743/.tmp/family1/f7e5458e90624154a6d5129ef71a80e1 2023-07-11 17:54:30,485 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/dada713f65e06525f8aa63e933747743/.tmp/family1/f7e5458e90624154a6d5129ef71a80e1 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/dada713f65e06525f8aa63e933747743/family1/f7e5458e90624154a6d5129ef71a80e1 2023-07-11 17:54:30,489 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/dada713f65e06525f8aa63e933747743/family1/f7e5458e90624154a6d5129ef71a80e1, entries=1, sequenceid=41, filesize=5.0 K 2023-07-11 17:54:30,490 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for dada713f65e06525f8aa63e933747743 in 830ms, sequenceid=41, compaction requested=true 2023-07-11 17:54:30,490 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for dada713f65e06525f8aa63e933747743: 2023-07-11 17:54:30,490 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689098059290.dada713f65e06525f8aa63e933747743. 2023-07-11 17:54:30,490 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 17:54:30,490 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 17:54:30,491 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:30,491 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-07-11 17:54:30,491 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-07-11 17:54:30,493 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:30,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:30,493 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:30,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:54:30,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:54:30,494 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:30,494 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 17:54:30,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:54:30,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:54:30,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:30,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:30,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:54:30,496 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-07-11 17:54:30,496 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6ecfdc6e[Count = 0] remaining members to acquire global barrier 2023-07-11 17:54:30,496 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-07-11 17:54:30,496 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:30,497 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:30,497 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:30,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:30,497 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-07-11 17:54:30,497 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-07-11 17:54:30,497 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase9.apache.org,45839,1689097999112' in zk 2023-07-11 17:54:30,497 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:30,497 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 17:54:30,499 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:30,499 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-07-11 17:54:30,499 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:54:30,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:30,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:54:30,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:54:30,499 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-07-11 17:54:30,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:54:30,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:54:30,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:30,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:30,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:54:30,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:30,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:30,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase9.apache.org,45839,1689097999112': 2023-07-11 17:54:30,503 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-07-11 17:54:30,503 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-07-11 17:54:30,503 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 17:54:30,503 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 17:54:30,503 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:30,503 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 17:54:30,504 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:30,505 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:30,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:30,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:54:30,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:54:30,505 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:30,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:30,505 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:54:30,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:54:30,505 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:54:30,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:54:30,505 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:30,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:30,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:30,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:54:30,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:30,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:30,507 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:30,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:54:30,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:30,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:30,510 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:30,510 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:54:30,510 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:30,510 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:54:30,510 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:30,510 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:54:30,510 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-07-11 17:54:30,511 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 17:54:30,510 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:54:30,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:54:30,511 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:30,511 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:30,511 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:30,511 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:30,511 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-07-11 17:54:30,511 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:54:30,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:54:30,511 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 17:54:30,611 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 17:54:30,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 17:54:30,614 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=36885] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:30,615 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-07-11 17:54:30,616 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=42, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-07-11 17:54:30,617 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-07-11 17:54:30,617 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=42, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1689098670617 2023-07-11 17:54:30,619 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-07-11 17:54:30,620 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-07-11 17:54:30,620 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-07-11 17:54:30,621 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] zookeeper.ReadOnlyZKClient(139): Connect 0x24889070 to 127.0.0.1:50702 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 17:54:30,632 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6276ed85, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 17:54:30,632 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-07-11 17:54:31,468 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601031ecb2d1cc779429ba35b2cb351d1bb0e to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601031ecb2d1cc779429ba35b2cb351d1bb0e 2023-07-11 17:54:31,469 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-07-11 17:54:31,483 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 17:54:31,485 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:56872, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 17:54:31,491 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-11 17:54:31,493 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:42810, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-11 17:54:31,503 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/77ae245924594708809871364302335c first=Optional[r3] last=Optional[r6] 2023-07-11 17:54:31,504 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689098059290.dada713f65e06525f8aa63e933747743., hostname=jenkins-hbase9.apache.org,45839,1689097999112, seqNum=2 for row with hfile group [{family1,hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/77ae245924594708809871364302335c}] 2023-07-11 17:54:31,508 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(763): Validating hfile at hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/77ae245924594708809871364302335c for inclusion in dada713f65e06525f8aa63e933747743/family1 2023-07-11 17:54:31,510 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-07-11 17:54:31,510 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(777): Region bounds: first= last= 2023-07-11 17:54:31,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HRegion(2446): Flush status journal for dada713f65e06525f8aa63e933747743: 2023-07-11 17:54:31,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/77ae245924594708809871364302335c to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__mq151g4oisel1rmfk95ehd18mlgo9mcopbaaajheaknl8ul84l8n2lpjvtbd3don/family1/77ae245924594708809871364302335c 2023-07-11 17:54:31,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__mq151g4oisel1rmfk95ehd18mlgo9mcopbaaajheaknl8ul84l8n2lpjvtbd3don/family1/77ae245924594708809871364302335c as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/dada713f65e06525f8aa63e933747743/family1/5fbe48cd696a40e38a1d079a24e87a81_SeqId_44_ 2023-07-11 17:54:31,514 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(849): Loaded HFile hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__mq151g4oisel1rmfk95ehd18mlgo9mcopbaaajheaknl8ul84l8n2lpjvtbd3don/family1/77ae245924594708809871364302335c into dada713f65e06525f8aa63e933747743/family1 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/dada713f65e06525f8aa63e933747743/family1/5fbe48cd696a40e38a1d079a24e87a81_SeqId_44_ - updating store file list. 2023-07-11 17:54:31,519 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(882): Loaded HFile hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/dada713f65e06525f8aa63e933747743/family1/5fbe48cd696a40e38a1d079a24e87a81_SeqId_44_ into dada713f65e06525f8aa63e933747743/family1 2023-07-11 17:54:31,519 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(855): Successfully loaded hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__mq151g4oisel1rmfk95ehd18mlgo9mcopbaaajheaknl8ul84l8n2lpjvtbd3don/family1/77ae245924594708809871364302335c into dada713f65e06525f8aa63e933747743/family1 (new location: hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/dada713f65e06525f8aa63e933747743/family1/5fbe48cd696a40e38a1d079a24e87a81_SeqId_44_) 2023-07-11 17:54:31,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__mq151g4oisel1rmfk95ehd18mlgo9mcopbaaajheaknl8ul84l8n2lpjvtbd3don/family1/77ae245924594708809871364302335c 2023-07-11 17:54:31,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-07-11 17:54:31,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51565 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-07-11 17:54:31,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(1912): dada713f65e06525f8aa63e933747743/family1 is initiating minor compaction 2023-07-11 17:54:31,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@2b9d8681; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-11 17:54:31,522 INFO [RS:0;jenkins-hbase9:45839-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of dada713f65e06525f8aa63e933747743/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689098059290.dada713f65e06525f8aa63e933747743. 2023-07-11 17:54:31,522 INFO [RS:0;jenkins-hbase9:45839-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/dada713f65e06525f8aa63e933747743/family1/1ffee809b31e405ea3f9233abe4b9833, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/dada713f65e06525f8aa63e933747743/family1/7037e7a970454a3fbb03d377251a0f1b, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/dada713f65e06525f8aa63e933747743/family1/f7d3af560ea049749746dd23da462c88, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/dada713f65e06525f8aa63e933747743/family1/ff4f6297422240d7a7a414a749e90a11, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/dada713f65e06525f8aa63e933747743/family1/684f54f0f3d5418198d8e7d4f97a1cd4, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/dada713f65e06525f8aa63e933747743/family1/f70a9936af374bf3ae13c06aeb919525, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/dada713f65e06525f8aa63e933747743/family1/7b15bdf7e1eb463489e82a375051940c, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/dada713f65e06525f8aa63e933747743/family1/d3ef9327d6954886953d8d9cfd875ff8, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/dada713f65e06525f8aa63e933747743/family1/f7e5458e90624154a6d5129ef71a80e1, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/dada713f65e06525f8aa63e933747743/family1/5fbe48cd696a40e38a1d079a24e87a81_SeqId_44_] into tmpdir=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/dada713f65e06525f8aa63e933747743/.tmp, totalSize=50.4 K 2023-07-11 17:54:31,522 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] compactions.Compactor(207): Compacting 1ffee809b31e405ea3f9233abe4b9833, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-07-11 17:54:31,522 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] compactions.Compactor(207): Compacting 7037e7a970454a3fbb03d377251a0f1b, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-07-11 17:54:31,523 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] compactions.Compactor(207): Compacting f7d3af560ea049749746dd23da462c88, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-07-11 17:54:31,523 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] compactions.Compactor(207): Compacting ff4f6297422240d7a7a414a749e90a11, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-07-11 17:54:31,523 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] compactions.Compactor(207): Compacting 684f54f0f3d5418198d8e7d4f97a1cd4, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-07-11 17:54:31,523 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] compactions.Compactor(207): Compacting f70a9936af374bf3ae13c06aeb919525, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-07-11 17:54:31,523 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] compactions.Compactor(207): Compacting 7b15bdf7e1eb463489e82a375051940c, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-07-11 17:54:31,523 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] compactions.Compactor(207): Compacting d3ef9327d6954886953d8d9cfd875ff8, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-07-11 17:54:31,523 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] compactions.Compactor(207): Compacting f7e5458e90624154a6d5129ef71a80e1, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-07-11 17:54:31,523 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] compactions.Compactor(207): Compacting 5fbe48cd696a40e38a1d079a24e87a81_SeqId_44_, keycount=4, bloomtype=ROW, size=5.6 K, encoding=NONE, compression=NONE, seqNum=45 2023-07-11 17:54:31,524 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-07-11 17:54:31,525 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 17:54:31,527 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151228609c7efc8483464fa47b39542d30f192 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151228609c7efc8483464fa47b39542d30f192 2023-07-11 17:54:31,528 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512315626a962fac24c829891077d79afe154 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512315626a962fac24c829891077d79afe154 2023-07-11 17:54:31,530 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160101742f1b4294ff45d8a24c93df942a4ff0 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160101742f1b4294ff45d8a24c93df942a4ff0 2023-07-11 17:54:31,531 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601038afdd9fad5fc4133b498de727a39fd62 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601038afdd9fad5fc4133b498de727a39fd62 2023-07-11 17:54:31,531 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 4 expired mob files are deleted 2023-07-11 17:54:31,531 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-07-11 17:54:31,531 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-07-11 17:54:31,531 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-07-11 17:54:31,531 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-07-11 17:54:31,531 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-07-11 17:54:31,531 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-07-11 17:54:31,531 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-07-11 17:54:31,531 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-07-11 17:54:31,531 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-07-11 17:54:31,552 INFO [RS:0;jenkins-hbase9:45839-shortCompactions-0] throttle.PressureAwareThroughputController(145): dada713f65e06525f8aa63e933747743#family1#compaction#60 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-11 17:54:31,976 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/dada713f65e06525f8aa63e933747743/.tmp/family1/f9de386ce4e84f3b9a0b6b84e11d722a as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/dada713f65e06525f8aa63e933747743/family1/f9de386ce4e84f3b9a0b6b84e11d722a 2023-07-11 17:54:31,980 INFO [RS:0;jenkins-hbase9:45839-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in dada713f65e06525f8aa63e933747743/family1 of dada713f65e06525f8aa63e933747743 into f9de386ce4e84f3b9a0b6b84e11d722a(size=6.8 K), total size for store is 198.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-11 17:54:31,981 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for dada713f65e06525f8aa63e933747743: 2023-07-11 17:54:31,981 INFO [RS:0;jenkins-hbase9:45839-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689098059290.dada713f65e06525f8aa63e933747743., storeName=family1, fileCount=10, fileSize=50.4 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.6 K), priority=2, time=1689098071522; duration=0sec 2023-07-11 17:54:31,981 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-11 17:54:32,049 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/dada713f65e06525f8aa63e933747743/family1/1ffee809b31e405ea3f9233abe4b9833, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/dada713f65e06525f8aa63e933747743/family1/7037e7a970454a3fbb03d377251a0f1b, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/dada713f65e06525f8aa63e933747743/family1/f7d3af560ea049749746dd23da462c88, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/dada713f65e06525f8aa63e933747743/family1/ff4f6297422240d7a7a414a749e90a11, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/dada713f65e06525f8aa63e933747743/family1/684f54f0f3d5418198d8e7d4f97a1cd4, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/dada713f65e06525f8aa63e933747743/family1/f70a9936af374bf3ae13c06aeb919525, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/dada713f65e06525f8aa63e933747743/family1/7b15bdf7e1eb463489e82a375051940c, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/dada713f65e06525f8aa63e933747743/family1/d3ef9327d6954886953d8d9cfd875ff8, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/dada713f65e06525f8aa63e933747743/family1/f7e5458e90624154a6d5129ef71a80e1, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/dada713f65e06525f8aa63e933747743/family1/5fbe48cd696a40e38a1d079a24e87a81_SeqId_44_] to archive 2023-07-11 17:54:32,050 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 17:54:32,052 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/dada713f65e06525f8aa63e933747743/family1/1ffee809b31e405ea3f9233abe4b9833 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/dada713f65e06525f8aa63e933747743/family1/1ffee809b31e405ea3f9233abe4b9833 2023-07-11 17:54:32,053 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/dada713f65e06525f8aa63e933747743/family1/7037e7a970454a3fbb03d377251a0f1b to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/dada713f65e06525f8aa63e933747743/family1/7037e7a970454a3fbb03d377251a0f1b 2023-07-11 17:54:32,054 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/dada713f65e06525f8aa63e933747743/family1/f7d3af560ea049749746dd23da462c88 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/dada713f65e06525f8aa63e933747743/family1/f7d3af560ea049749746dd23da462c88 2023-07-11 17:54:32,055 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/dada713f65e06525f8aa63e933747743/family1/ff4f6297422240d7a7a414a749e90a11 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/dada713f65e06525f8aa63e933747743/family1/ff4f6297422240d7a7a414a749e90a11 2023-07-11 17:54:32,056 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/dada713f65e06525f8aa63e933747743/family1/684f54f0f3d5418198d8e7d4f97a1cd4 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/dada713f65e06525f8aa63e933747743/family1/684f54f0f3d5418198d8e7d4f97a1cd4 2023-07-11 17:54:32,058 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/dada713f65e06525f8aa63e933747743/family1/f70a9936af374bf3ae13c06aeb919525 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/dada713f65e06525f8aa63e933747743/family1/f70a9936af374bf3ae13c06aeb919525 2023-07-11 17:54:32,059 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/dada713f65e06525f8aa63e933747743/family1/7b15bdf7e1eb463489e82a375051940c to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/dada713f65e06525f8aa63e933747743/family1/7b15bdf7e1eb463489e82a375051940c 2023-07-11 17:54:32,060 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/dada713f65e06525f8aa63e933747743/family1/d3ef9327d6954886953d8d9cfd875ff8 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/dada713f65e06525f8aa63e933747743/family1/d3ef9327d6954886953d8d9cfd875ff8 2023-07-11 17:54:32,061 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/dada713f65e06525f8aa63e933747743/family1/f7e5458e90624154a6d5129ef71a80e1 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/dada713f65e06525f8aa63e933747743/family1/f7e5458e90624154a6d5129ef71a80e1 2023-07-11 17:54:32,062 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/dada713f65e06525f8aa63e933747743/family1/5fbe48cd696a40e38a1d079a24e87a81_SeqId_44_ to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/dada713f65e06525f8aa63e933747743/family1/5fbe48cd696a40e38a1d079a24e87a81_SeqId_44_ 2023-07-11 17:54:32,376 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512050e945bba2ca9475d80bbf99eeef1f26a to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512050e945bba2ca9475d80bbf99eeef1f26a 2023-07-11 17:54:32,377 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-07-11 17:54:32,401 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/bf33935a5a114240a748951deb407374 first=Optional[r00] last=Optional[r2] 2023-07-11 17:54:32,402 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689098059290.dada713f65e06525f8aa63e933747743., hostname=jenkins-hbase9.apache.org,45839,1689097999112, seqNum=2 for row with hfile group [{family1,hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/bf33935a5a114240a748951deb407374}] 2023-07-11 17:54:32,404 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(763): Validating hfile at hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/bf33935a5a114240a748951deb407374 for inclusion in dada713f65e06525f8aa63e933747743/family1 2023-07-11 17:54:32,407 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-07-11 17:54:32,407 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(777): Region bounds: first= last= 2023-07-11 17:54:32,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HRegion(2446): Flush status journal for dada713f65e06525f8aa63e933747743: 2023-07-11 17:54:32,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/bf33935a5a114240a748951deb407374 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__c877rg78fi5rvo9bdmte5o53pkrnff82krq5vcmr3cskqg2dg4dcfl25b53q5r38/family1/bf33935a5a114240a748951deb407374 2023-07-11 17:54:32,410 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__c877rg78fi5rvo9bdmte5o53pkrnff82krq5vcmr3cskqg2dg4dcfl25b53q5r38/family1/bf33935a5a114240a748951deb407374 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/dada713f65e06525f8aa63e933747743/family1/b75e27441e5c436fbb371ea870cbe33b_SeqId_47_ 2023-07-11 17:54:32,411 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(849): Loaded HFile hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__c877rg78fi5rvo9bdmte5o53pkrnff82krq5vcmr3cskqg2dg4dcfl25b53q5r38/family1/bf33935a5a114240a748951deb407374 into dada713f65e06525f8aa63e933747743/family1 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/dada713f65e06525f8aa63e933747743/family1/b75e27441e5c436fbb371ea870cbe33b_SeqId_47_ - updating store file list. 2023-07-11 17:54:32,415 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(882): Loaded HFile hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/dada713f65e06525f8aa63e933747743/family1/b75e27441e5c436fbb371ea870cbe33b_SeqId_47_ into dada713f65e06525f8aa63e933747743/family1 2023-07-11 17:54:32,415 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(855): Successfully loaded hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__c877rg78fi5rvo9bdmte5o53pkrnff82krq5vcmr3cskqg2dg4dcfl25b53q5r38/family1/bf33935a5a114240a748951deb407374 into dada713f65e06525f8aa63e933747743/family1 (new location: hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/dada713f65e06525f8aa63e933747743/family1/b75e27441e5c436fbb371ea870cbe33b_SeqId_47_) 2023-07-11 17:54:32,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__c877rg78fi5rvo9bdmte5o53pkrnff82krq5vcmr3cskqg2dg4dcfl25b53q5r38/family1/bf33935a5a114240a748951deb407374 2023-07-11 17:54:32,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-07-11 17:54:32,417 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 399433 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-07-11 17:54:32,417 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(1912): dada713f65e06525f8aa63e933747743/family1 is initiating minor compaction (all files) 2023-07-11 17:54:32,417 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@32d30515; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-11 17:54:32,417 INFO [RS:0;jenkins-hbase9:45839-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of dada713f65e06525f8aa63e933747743/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689098059290.dada713f65e06525f8aa63e933747743. 2023-07-11 17:54:32,417 INFO [RS:0;jenkins-hbase9:45839-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/dada713f65e06525f8aa63e933747743/family1/98d33ab1851c4c4aaad36def709e50ec, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/dada713f65e06525f8aa63e933747743/family1/f9de386ce4e84f3b9a0b6b84e11d722a, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/dada713f65e06525f8aa63e933747743/family1/b75e27441e5c436fbb371ea870cbe33b_SeqId_47_] into tmpdir=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/dada713f65e06525f8aa63e933747743/.tmp, totalSize=390.1 K 2023-07-11 17:54:32,418 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] compactions.Compactor(207): Compacting 98d33ab1851c4c4aaad36def709e50ec, keycount=1000, bloomtype=ROW, size=191.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878822106 2023-07-11 17:54:32,418 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] compactions.Compactor(207): Compacting f9de386ce4e84f3b9a0b6b84e11d722a, keycount=9, bloomtype=ROW, size=6.8 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621222106 2023-07-11 17:54:32,418 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] compactions.Compactor(207): Compacting b75e27441e5c436fbb371ea870cbe33b_SeqId_47_, keycount=1002, bloomtype=ROW, size=191.8 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878822106 2023-07-11 17:54:32,419 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-07-11 17:54:32,419 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 17:54:32,421 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151130f3e80b559e01475d8d5f0b77ae3ddfd3 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151130f3e80b559e01475d8d5f0b77ae3ddfd3 2023-07-11 17:54:32,422 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151201eeffd2f30dc64c9cb955ddbf2371707a to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151201eeffd2f30dc64c9cb955ddbf2371707a 2023-07-11 17:54:32,424 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015120517e434489c524a328d8feeb2751c8275 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015120517e434489c524a328d8feeb2751c8275 2023-07-11 17:54:32,424 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 3 expired mob files are deleted 2023-07-11 17:54:32,424 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-07-11 17:54:32,424 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-07-11 17:54:32,424 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-07-11 17:54:32,425 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-07-11 17:54:32,426 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=42, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-07-11 17:54:32,428 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 1.8120 sec 2023-07-11 17:54:32,433 INFO [RS:0;jenkins-hbase9:45839-shortCompactions-0] throttle.PressureAwareThroughputController(145): dada713f65e06525f8aa63e933747743#family1#compaction#61 average throughput is 25.80 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-11 17:54:32,508 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.HMaster$12(2454): Client=jenkins//172.31.2.10 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-07-11 17:54:32,509 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure2.ProcedureExecutor(1029): Stored pid=43, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:32,857 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-11 17:54:32,857 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7b26b505 to 127.0.0.1:50702 2023-07-11 17:54:32,857 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 17:54:32,857 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-11 17:54:32,857 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x046d775d to 127.0.0.1:50702 2023-07-11 17:54:32,858 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 17:54:32,859 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-11 17:54:32,859 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x53508fb3 to 127.0.0.1:50702 2023-07-11 17:54:32,859 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 17:54:32,859 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-11 17:54:32,859 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x24889070 to 127.0.0.1:50702 2023-07-11 17:54:32,859 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 17:54:32,918 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-07-11 17:54:32,919 DEBUG [PEWorker-5] util.FSTableDescriptors(519): Deleted hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000001 2023-07-11 17:54:32,919 INFO [PEWorker-5] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-07-11 17:54:32,921 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=44, ppid=43, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly}] 2023-07-11 17:54:32,924 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=dada713f65e06525f8aa63e933747743, REOPEN/MOVE}] 2023-07-11 17:54:32,924 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=dada713f65e06525f8aa63e933747743, REOPEN/MOVE 2023-07-11 17:54:32,925 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=dada713f65e06525f8aa63e933747743, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:32,925 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689098059290.dada713f65e06525f8aa63e933747743.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1689098072925"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689098072925"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689098072925"}]},"ts":"1689098072925"} 2023-07-11 17:54:32,926 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=45, state=RUNNABLE; CloseRegionProcedure dada713f65e06525f8aa63e933747743, server=jenkins-hbase9.apache.org,45839,1689097999112}] 2023-07-11 17:54:33,077 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close dada713f65e06525f8aa63e933747743 2023-07-11 17:54:33,077 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing dada713f65e06525f8aa63e933747743, disabling compactions & flushes 2023-07-11 17:54:33,077 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1858): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689098059290.dada713f65e06525f8aa63e933747743. 2023-07-11 17:54:33,670 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/dada713f65e06525f8aa63e933747743/.tmp/family1/d9a96d5c7dc6458d9733a358f327b3b9 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/dada713f65e06525f8aa63e933747743/family1/d9a96d5c7dc6458d9733a358f327b3b9 2023-07-11 17:54:33,675 INFO [RS:0;jenkins-hbase9:45839-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in dada713f65e06525f8aa63e933747743/family1 of dada713f65e06525f8aa63e933747743 into d9a96d5c7dc6458d9733a358f327b3b9(size=193.0 K), total size for store is 193.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-07-11 17:54:33,675 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for dada713f65e06525f8aa63e933747743: 2023-07-11 17:54:33,675 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689098059290.dada713f65e06525f8aa63e933747743. 2023-07-11 17:54:33,675 INFO [RS:0;jenkins-hbase9:45839-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689098059290.dada713f65e06525f8aa63e933747743., storeName=family1, fileCount=3, fileSize=390.1 K (191.4 K, 6.8 K, 191.8 K), priority=2, time=1689098072417; duration=1sec 2023-07-11 17:54:33,675 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689098059290.dada713f65e06525f8aa63e933747743. 2023-07-11 17:54:33,675 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689098059290.dada713f65e06525f8aa63e933747743. after waiting 0 ms 2023-07-11 17:54:33,675 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-11 17:54:33,675 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689098059290.dada713f65e06525f8aa63e933747743. 2023-07-11 17:54:33,677 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689098059290.dada713f65e06525f8aa63e933747743.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/dada713f65e06525f8aa63e933747743/family1/98d33ab1851c4c4aaad36def709e50ec, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/dada713f65e06525f8aa63e933747743/family1/f9de386ce4e84f3b9a0b6b84e11d722a, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/dada713f65e06525f8aa63e933747743/family1/b75e27441e5c436fbb371ea870cbe33b_SeqId_47_] to archive 2023-07-11 17:54:33,677 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689098059290.dada713f65e06525f8aa63e933747743.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 17:54:33,679 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689098059290.dada713f65e06525f8aa63e933747743.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/dada713f65e06525f8aa63e933747743/family1/98d33ab1851c4c4aaad36def709e50ec to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/dada713f65e06525f8aa63e933747743/family1/98d33ab1851c4c4aaad36def709e50ec 2023-07-11 17:54:33,680 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689098059290.dada713f65e06525f8aa63e933747743.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/dada713f65e06525f8aa63e933747743/family1/f9de386ce4e84f3b9a0b6b84e11d722a to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/dada713f65e06525f8aa63e933747743/family1/f9de386ce4e84f3b9a0b6b84e11d722a 2023-07-11 17:54:33,682 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689098059290.dada713f65e06525f8aa63e933747743.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/dada713f65e06525f8aa63e933747743/family1/b75e27441e5c436fbb371ea870cbe33b_SeqId_47_ to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/dada713f65e06525f8aa63e933747743/family1/b75e27441e5c436fbb371ea870cbe33b_SeqId_47_ 2023-07-11 17:54:33,686 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/dada713f65e06525f8aa63e933747743/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-07-11 17:54:33,687 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689098059290.dada713f65e06525f8aa63e933747743. 2023-07-11 17:54:33,687 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for dada713f65e06525f8aa63e933747743: 2023-07-11 17:54:33,687 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(3510): Not adding moved region record: dada713f65e06525f8aa63e933747743 to self. 2023-07-11 17:54:33,688 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed dada713f65e06525f8aa63e933747743 2023-07-11 17:54:33,689 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=dada713f65e06525f8aa63e933747743, regionState=CLOSED 2023-07-11 17:54:33,689 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689098059290.dada713f65e06525f8aa63e933747743.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1689098073689"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689098073689"}]},"ts":"1689098073689"} 2023-07-11 17:54:33,691 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=45 2023-07-11 17:54:33,691 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=45, state=SUCCESS; CloseRegionProcedure dada713f65e06525f8aa63e933747743, server=jenkins-hbase9.apache.org,45839,1689097999112 in 764 msec 2023-07-11 17:54:33,691 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=dada713f65e06525f8aa63e933747743, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase9.apache.org,45839,1689097999112; forceNewPlan=false, retain=true 2023-07-11 17:54:33,842 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=dada713f65e06525f8aa63e933747743, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:33,842 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689098059290.dada713f65e06525f8aa63e933747743.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1689098073842"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689098073842"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689098073842"}]},"ts":"1689098073842"} 2023-07-11 17:54:33,844 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=47, ppid=45, state=RUNNABLE; OpenRegionProcedure dada713f65e06525f8aa63e933747743, server=jenkins-hbase9.apache.org,45839,1689097999112}] 2023-07-11 17:54:33,998 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689098059290.dada713f65e06525f8aa63e933747743. 2023-07-11 17:54:33,998 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => dada713f65e06525f8aa63e933747743, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689098059290.dada713f65e06525f8aa63e933747743.', STARTKEY => '', ENDKEY => ''} 2023-07-11 17:54:33,999 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly dada713f65e06525f8aa63e933747743 2023-07-11 17:54:33,999 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689098059290.dada713f65e06525f8aa63e933747743.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 17:54:33,999 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for dada713f65e06525f8aa63e933747743 2023-07-11 17:54:33,999 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for dada713f65e06525f8aa63e933747743 2023-07-11 17:54:34,000 INFO [StoreOpener-dada713f65e06525f8aa63e933747743-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region dada713f65e06525f8aa63e933747743 2023-07-11 17:54:34,001 DEBUG [StoreOpener-dada713f65e06525f8aa63e933747743-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/dada713f65e06525f8aa63e933747743/family1 2023-07-11 17:54:34,001 DEBUG [StoreOpener-dada713f65e06525f8aa63e933747743-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/dada713f65e06525f8aa63e933747743/family1 2023-07-11 17:54:34,001 INFO [StoreOpener-dada713f65e06525f8aa63e933747743-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dada713f65e06525f8aa63e933747743 columnFamilyName family1 2023-07-11 17:54:34,006 DEBUG [StoreOpener-dada713f65e06525f8aa63e933747743-1] regionserver.HStore(539): loaded hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/dada713f65e06525f8aa63e933747743/family1/d9a96d5c7dc6458d9733a358f327b3b9 2023-07-11 17:54:34,006 INFO [StoreOpener-dada713f65e06525f8aa63e933747743-1] regionserver.HStore(310): Store=dada713f65e06525f8aa63e933747743/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 17:54:34,007 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/dada713f65e06525f8aa63e933747743 2023-07-11 17:54:34,008 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/dada713f65e06525f8aa63e933747743 2023-07-11 17:54:34,010 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for dada713f65e06525f8aa63e933747743 2023-07-11 17:54:34,011 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened dada713f65e06525f8aa63e933747743; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62822397, jitterRate=-0.06387333571910858}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 17:54:34,011 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for dada713f65e06525f8aa63e933747743: 2023-07-11 17:54:34,012 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689098059290.dada713f65e06525f8aa63e933747743., pid=47, masterSystemTime=1689098073995 2023-07-11 17:54:34,013 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689098059290.dada713f65e06525f8aa63e933747743. 2023-07-11 17:54:34,013 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689098059290.dada713f65e06525f8aa63e933747743. 2023-07-11 17:54:34,014 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=dada713f65e06525f8aa63e933747743, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:34,014 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689098059290.dada713f65e06525f8aa63e933747743.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1689098074014"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689098074014"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689098074014"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689098074014"}]},"ts":"1689098074014"} 2023-07-11 17:54:34,016 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=47, resume processing ppid=45 2023-07-11 17:54:34,016 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=47, ppid=45, state=SUCCESS; OpenRegionProcedure dada713f65e06525f8aa63e933747743, server=jenkins-hbase9.apache.org,45839,1689097999112 in 171 msec 2023-07-11 17:54:34,018 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=44 2023-07-11 17:54:34,018 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=44, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=dada713f65e06525f8aa63e933747743, REOPEN/MOVE in 1.0920 sec 2023-07-11 17:54:34,020 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=43 2023-07-11 17:54:34,020 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=43, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.0980 sec 2023-07-11 17:54:34,022 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=43, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.5130 sec 2023-07-11 17:54:34,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1230): Checking to see if procedure is done pid=43 2023-07-11 17:54:34,023 INFO [Listener at localhost/43271] compactions.TestMobCompactor(278): alter status finished 2023-07-11 17:54:34,024 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=36885] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:34,025 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-07-11 17:54:34,026 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-07-11 17:54:34,027 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-07-11 17:54:34,027 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1689098674027 2023-07-11 17:54:34,027 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-07-11 17:54:34,028 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-07-11 17:54:34,028 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-07-11 17:54:34,028 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] zookeeper.ReadOnlyZKClient(139): Connect 0x0423b889 to 127.0.0.1:50702 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 17:54:34,032 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@516c774d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 17:54:34,032 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-07-11 17:54:34,032 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-07-11 17:54:34,032 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-07-11 17:54:34,032 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-07-11 17:54:34,032 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-07-11 17:54:34,860 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128a924d0d0accf4009b9b8a3bf52900d6a to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151128a924d0d0accf4009b9b8a3bf52900d6a 2023-07-11 17:54:34,861 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-07-11 17:54:34,873 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 17:54:34,875 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:56882, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 17:54:34,881 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-11 17:54:34,883 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:42822, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-11 17:54:34,892 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/fb53f1ec76fd4898bb9ee44fa013fcdd first=Optional[r05] last=Optional[r8] 2023-07-11 17:54:34,892 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689098059290.dada713f65e06525f8aa63e933747743., hostname=jenkins-hbase9.apache.org,45839,1689097999112, seqNum=51 for row with hfile group [{family1,hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/fb53f1ec76fd4898bb9ee44fa013fcdd}] 2023-07-11 17:54:34,896 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(763): Validating hfile at hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/fb53f1ec76fd4898bb9ee44fa013fcdd for inclusion in dada713f65e06525f8aa63e933747743/family1 2023-07-11 17:54:34,898 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-07-11 17:54:34,899 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(777): Region bounds: first= last= 2023-07-11 17:54:34,899 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HRegion(2446): Flush status journal for dada713f65e06525f8aa63e933747743: 2023-07-11 17:54:34,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/fb53f1ec76fd4898bb9ee44fa013fcdd to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__i5agjff8r34ok4sc2cfml6f6v405b81gu762qrmuqtmvtfmmfusdbaeo88dd44he/family1/fb53f1ec76fd4898bb9ee44fa013fcdd 2023-07-11 17:54:34,902 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__i5agjff8r34ok4sc2cfml6f6v405b81gu762qrmuqtmvtfmmfusdbaeo88dd44he/family1/fb53f1ec76fd4898bb9ee44fa013fcdd as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/dada713f65e06525f8aa63e933747743/family1/3667a0ee7462429f9e5fef09124ead8f_SeqId_53_ 2023-07-11 17:54:34,903 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(849): Loaded HFile hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__i5agjff8r34ok4sc2cfml6f6v405b81gu762qrmuqtmvtfmmfusdbaeo88dd44he/family1/fb53f1ec76fd4898bb9ee44fa013fcdd into dada713f65e06525f8aa63e933747743/family1 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/dada713f65e06525f8aa63e933747743/family1/3667a0ee7462429f9e5fef09124ead8f_SeqId_53_ - updating store file list. 2023-07-11 17:54:34,907 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(882): Loaded HFile hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/dada713f65e06525f8aa63e933747743/family1/3667a0ee7462429f9e5fef09124ead8f_SeqId_53_ into dada713f65e06525f8aa63e933747743/family1 2023-07-11 17:54:34,907 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(855): Successfully loaded hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__i5agjff8r34ok4sc2cfml6f6v405b81gu762qrmuqtmvtfmmfusdbaeo88dd44he/family1/fb53f1ec76fd4898bb9ee44fa013fcdd into dada713f65e06525f8aa63e933747743/family1 (new location: hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/dada713f65e06525f8aa63e933747743/family1/3667a0ee7462429f9e5fef09124ead8f_SeqId_53_) 2023-07-11 17:54:34,908 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__i5agjff8r34ok4sc2cfml6f6v405b81gu762qrmuqtmvtfmmfusdbaeo88dd44he/family1/fb53f1ec76fd4898bb9ee44fa013fcdd 2023-07-11 17:54:34,909 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-07-11 17:54:34,910 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 17:54:34,912 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015112079d5a026f4024d1890ee4448ac107296 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015112079d5a026f4024d1890ee4448ac107296 2023-07-11 17:54:34,913 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151128dd20db73350044fa83a5d0b21a6d4b06 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151128dd20db73350044fa83a5d0b21a6d4b06 2023-07-11 17:54:34,913 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2 expired mob files are deleted 2023-07-11 17:54:34,913 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-07-11 17:54:34,913 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-07-11 17:54:34,913 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-07-11 17:54:34,913 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-07-11 17:54:34,913 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-07-11 17:54:34,913 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-07-11 17:54:34,914 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-07-11 17:54:34,916 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 889 msec 2023-07-11 17:54:34,967 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.HMaster$12(2454): Client=jenkins//172.31.2.10 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-07-11 17:54:34,968 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:35,377 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000003 2023-07-11 17:54:35,378 DEBUG [PEWorker-1] util.FSTableDescriptors(519): Deleted hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-07-11 17:54:35,378 INFO [PEWorker-1] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000003 2023-07-11 17:54:35,381 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=50, ppid=49, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly}] 2023-07-11 17:54:35,384 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=dada713f65e06525f8aa63e933747743, REOPEN/MOVE}] 2023-07-11 17:54:35,385 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=dada713f65e06525f8aa63e933747743, REOPEN/MOVE 2023-07-11 17:54:35,385 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=dada713f65e06525f8aa63e933747743, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:35,385 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689098059290.dada713f65e06525f8aa63e933747743.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1689098075385"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689098075385"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689098075385"}]},"ts":"1689098075385"} 2023-07-11 17:54:35,387 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE; CloseRegionProcedure dada713f65e06525f8aa63e933747743, server=jenkins-hbase9.apache.org,45839,1689097999112}] 2023-07-11 17:54:35,539 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close dada713f65e06525f8aa63e933747743 2023-07-11 17:54:35,539 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing dada713f65e06525f8aa63e933747743, disabling compactions & flushes 2023-07-11 17:54:35,539 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689098059290.dada713f65e06525f8aa63e933747743. 2023-07-11 17:54:35,539 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689098059290.dada713f65e06525f8aa63e933747743. 2023-07-11 17:54:35,539 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689098059290.dada713f65e06525f8aa63e933747743. after waiting 0 ms 2023-07-11 17:54:35,539 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689098059290.dada713f65e06525f8aa63e933747743. 2023-07-11 17:54:35,544 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/dada713f65e06525f8aa63e933747743/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-07-11 17:54:35,545 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689098059290.dada713f65e06525f8aa63e933747743. 2023-07-11 17:54:35,545 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for dada713f65e06525f8aa63e933747743: 2023-07-11 17:54:35,545 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(3510): Not adding moved region record: dada713f65e06525f8aa63e933747743 to self. 2023-07-11 17:54:35,546 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed dada713f65e06525f8aa63e933747743 2023-07-11 17:54:35,547 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=dada713f65e06525f8aa63e933747743, regionState=CLOSED 2023-07-11 17:54:35,547 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689098059290.dada713f65e06525f8aa63e933747743.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1689098075547"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689098075547"}]},"ts":"1689098075547"} 2023-07-11 17:54:35,549 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=51 2023-07-11 17:54:35,550 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; CloseRegionProcedure dada713f65e06525f8aa63e933747743, server=jenkins-hbase9.apache.org,45839,1689097999112 in 161 msec 2023-07-11 17:54:35,550 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=dada713f65e06525f8aa63e933747743, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase9.apache.org,45839,1689097999112; forceNewPlan=false, retain=true 2023-07-11 17:54:35,701 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=dada713f65e06525f8aa63e933747743, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:35,701 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689098059290.dada713f65e06525f8aa63e933747743.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1689098075700"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689098075700"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689098075700"}]},"ts":"1689098075700"} 2023-07-11 17:54:35,703 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=53, ppid=51, state=RUNNABLE; OpenRegionProcedure dada713f65e06525f8aa63e933747743, server=jenkins-hbase9.apache.org,45839,1689097999112}] 2023-07-11 17:54:35,857 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689098059290.dada713f65e06525f8aa63e933747743. 2023-07-11 17:54:35,857 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => dada713f65e06525f8aa63e933747743, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689098059290.dada713f65e06525f8aa63e933747743.', STARTKEY => '', ENDKEY => ''} 2023-07-11 17:54:35,857 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly dada713f65e06525f8aa63e933747743 2023-07-11 17:54:35,857 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689098059290.dada713f65e06525f8aa63e933747743.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 17:54:35,858 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for dada713f65e06525f8aa63e933747743 2023-07-11 17:54:35,858 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for dada713f65e06525f8aa63e933747743 2023-07-11 17:54:35,859 INFO [StoreOpener-dada713f65e06525f8aa63e933747743-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region dada713f65e06525f8aa63e933747743 2023-07-11 17:54:35,859 DEBUG [StoreOpener-dada713f65e06525f8aa63e933747743-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/dada713f65e06525f8aa63e933747743/family1 2023-07-11 17:54:35,859 DEBUG [StoreOpener-dada713f65e06525f8aa63e933747743-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/dada713f65e06525f8aa63e933747743/family1 2023-07-11 17:54:35,860 INFO [StoreOpener-dada713f65e06525f8aa63e933747743-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dada713f65e06525f8aa63e933747743 columnFamilyName family1 2023-07-11 17:54:35,865 DEBUG [StoreOpener-dada713f65e06525f8aa63e933747743-1] regionserver.HStore(539): loaded hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/dada713f65e06525f8aa63e933747743/family1/3667a0ee7462429f9e5fef09124ead8f_SeqId_53_ 2023-07-11 17:54:35,868 DEBUG [StoreOpener-dada713f65e06525f8aa63e933747743-1] regionserver.HStore(539): loaded hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/dada713f65e06525f8aa63e933747743/family1/d9a96d5c7dc6458d9733a358f327b3b9 2023-07-11 17:54:35,868 INFO [StoreOpener-dada713f65e06525f8aa63e933747743-1] regionserver.HStore(310): Store=dada713f65e06525f8aa63e933747743/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 17:54:35,869 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/dada713f65e06525f8aa63e933747743 2023-07-11 17:54:35,870 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/dada713f65e06525f8aa63e933747743 2023-07-11 17:54:35,872 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for dada713f65e06525f8aa63e933747743 2023-07-11 17:54:35,872 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened dada713f65e06525f8aa63e933747743; next sequenceid=56; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65338809, jitterRate=-0.026375874876976013}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 17:54:35,873 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for dada713f65e06525f8aa63e933747743: 2023-07-11 17:54:35,873 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689098059290.dada713f65e06525f8aa63e933747743., pid=53, masterSystemTime=1689098075854 2023-07-11 17:54:35,875 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689098059290.dada713f65e06525f8aa63e933747743. 2023-07-11 17:54:35,875 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689098059290.dada713f65e06525f8aa63e933747743. 2023-07-11 17:54:35,875 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=dada713f65e06525f8aa63e933747743, regionState=OPEN, openSeqNum=56, regionLocation=jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:35,875 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689098059290.dada713f65e06525f8aa63e933747743.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1689098075875"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689098075875"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689098075875"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689098075875"}]},"ts":"1689098075875"} 2023-07-11 17:54:35,878 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=51 2023-07-11 17:54:35,878 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; OpenRegionProcedure dada713f65e06525f8aa63e933747743, server=jenkins-hbase9.apache.org,45839,1689097999112 in 173 msec 2023-07-11 17:54:35,879 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=51, resume processing ppid=50 2023-07-11 17:54:35,879 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=51, ppid=50, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=dada713f65e06525f8aa63e933747743, REOPEN/MOVE in 494 msec 2023-07-11 17:54:35,881 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=50, resume processing ppid=49 2023-07-11 17:54:35,881 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=50, ppid=49, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 499 msec 2023-07-11 17:54:35,883 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 915 msec 2023-07-11 17:54:35,884 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1230): Checking to see if procedure is done pid=49 2023-07-11 17:54:35,885 INFO [Listener at localhost/43271] compactions.TestMobCompactor(278): alter status finished 2023-07-11 17:54:35,886 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=36885] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-07-11 17:54:35,887 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] procedure2.ProcedureExecutor(1029): Stored pid=54, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-07-11 17:54:35,887 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=54, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-07-11 17:54:35,888 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-07-11 17:54:35,888 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=54, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1689098675888 2023-07-11 17:54:35,888 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-07-11 17:54:35,889 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 4 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-07-11 17:54:35,889 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-07-11 17:54:35,889 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] zookeeper.ReadOnlyZKClient(139): Connect 0x6b3cf84f to 127.0.0.1:50702 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 17:54:35,893 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@59582c7a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 17:54:35,893 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-07-11 17:54:35,894 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-07-11 17:54:35,894 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-07-11 17:54:35,894 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-07-11 17:54:35,894 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-07-11 17:54:35,894 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-07-11 17:54:35,894 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-07-11 17:54:35,894 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-07-11 17:54:35,894 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-07-11 17:54:35,894 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-07-11 17:54:35,895 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=54, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-07-11 17:54:35,896 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=54, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 9 msec 2023-07-11 17:54:35,945 INFO [Listener at localhost/43271] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly Thread=240 (was 260), OpenFileDescriptor=606 (was 629), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=178 (was 172) - SystemLoadAverage LEAK? -, ProcessCount=170 (was 170), AvailableMemoryMB=8494 (was 8649) 2023-07-11 17:54:35,957 INFO [Listener at localhost/43271] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily Thread=240, OpenFileDescriptor=606, MaxFileDescriptor=60000, SystemLoadAverage=178, ProcessCount=170, AvailableMemoryMB=8494 2023-07-11 17:54:35,959 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-07-11 17:54:35,960 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure2.ProcedureExecutor(1029): Stored pid=55, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:35,961 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_PRE_OPERATION 2023-07-11 17:54:35,962 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily" procId is: 55 2023-07-11 17:54:35,962 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-11 17:54:35,962 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-07-11 17:54:35,963 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8c00c428ffdb4840522b5e5a88c37ff1 2023-07-11 17:54:35,964 DEBUG [HFileArchiver-10] backup.HFileArchiver(153): Directory hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8c00c428ffdb4840522b5e5a88c37ff1 empty. 2023-07-11 17:54:35,964 DEBUG [HFileArchiver-10] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8c00c428ffdb4840522b5e5a88c37ff1 2023-07-11 17:54:35,964 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily regions 2023-07-11 17:54:36,063 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-07-11 17:54:36,264 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-07-11 17:54:36,373 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000001 2023-07-11 17:54:36,375 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(7675): creating {ENCODED => 8c00c428ffdb4840522b5e5a88c37ff1, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689098075959.8c00c428ffdb4840522b5e5a88c37ff1.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/.tmp 2023-07-11 17:54:36,565 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-07-11 17:54:36,780 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689098075959.8c00c428ffdb4840522b5e5a88c37ff1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 17:54:36,780 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1604): Closing 8c00c428ffdb4840522b5e5a88c37ff1, disabling compactions & flushes 2023-07-11 17:54:36,780 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689098075959.8c00c428ffdb4840522b5e5a88c37ff1. 2023-07-11 17:54:36,781 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689098075959.8c00c428ffdb4840522b5e5a88c37ff1. 2023-07-11 17:54:36,781 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689098075959.8c00c428ffdb4840522b5e5a88c37ff1. after waiting 0 ms 2023-07-11 17:54:36,781 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689098075959.8c00c428ffdb4840522b5e5a88c37ff1. 2023-07-11 17:54:36,781 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689098075959.8c00c428ffdb4840522b5e5a88c37ff1. 2023-07-11 17:54:36,781 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1558): Region close journal for 8c00c428ffdb4840522b5e5a88c37ff1: 2023-07-11 17:54:36,783 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_ADD_TO_META 2023-07-11 17:54:36,784 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689098075959.8c00c428ffdb4840522b5e5a88c37ff1.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1689098076784"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689098076784"}]},"ts":"1689098076784"} 2023-07-11 17:54:36,785 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-11 17:54:36,786 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-11 17:54:36,786 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689098076786"}]},"ts":"1689098076786"} 2023-07-11 17:54:36,787 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, state=ENABLING in hbase:meta 2023-07-11 17:54:36,790 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=8c00c428ffdb4840522b5e5a88c37ff1, ASSIGN}] 2023-07-11 17:54:36,792 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=8c00c428ffdb4840522b5e5a88c37ff1, ASSIGN 2023-07-11 17:54:36,792 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=8c00c428ffdb4840522b5e5a88c37ff1, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,45839,1689097999112; forceNewPlan=false, retain=false 2023-07-11 17:54:36,943 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=56 updating hbase:meta row=8c00c428ffdb4840522b5e5a88c37ff1, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:36,943 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689098075959.8c00c428ffdb4840522b5e5a88c37ff1.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1689098076943"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689098076943"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689098076943"}]},"ts":"1689098076943"} 2023-07-11 17:54:36,945 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=57, ppid=56, state=RUNNABLE; OpenRegionProcedure 8c00c428ffdb4840522b5e5a88c37ff1, server=jenkins-hbase9.apache.org,45839,1689097999112}] 2023-07-11 17:54:37,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-07-11 17:54:37,099 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689098075959.8c00c428ffdb4840522b5e5a88c37ff1. 2023-07-11 17:54:37,099 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8c00c428ffdb4840522b5e5a88c37ff1, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689098075959.8c00c428ffdb4840522b5e5a88c37ff1.', STARTKEY => '', ENDKEY => ''} 2023-07-11 17:54:37,100 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 8c00c428ffdb4840522b5e5a88c37ff1 2023-07-11 17:54:37,100 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689098075959.8c00c428ffdb4840522b5e5a88c37ff1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 17:54:37,100 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 8c00c428ffdb4840522b5e5a88c37ff1 2023-07-11 17:54:37,100 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 8c00c428ffdb4840522b5e5a88c37ff1 2023-07-11 17:54:37,101 INFO [StoreOpener-8c00c428ffdb4840522b5e5a88c37ff1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 8c00c428ffdb4840522b5e5a88c37ff1 2023-07-11 17:54:37,102 DEBUG [StoreOpener-8c00c428ffdb4840522b5e5a88c37ff1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8c00c428ffdb4840522b5e5a88c37ff1/family1 2023-07-11 17:54:37,102 DEBUG [StoreOpener-8c00c428ffdb4840522b5e5a88c37ff1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8c00c428ffdb4840522b5e5a88c37ff1/family1 2023-07-11 17:54:37,103 INFO [StoreOpener-8c00c428ffdb4840522b5e5a88c37ff1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8c00c428ffdb4840522b5e5a88c37ff1 columnFamilyName family1 2023-07-11 17:54:37,104 INFO [StoreOpener-8c00c428ffdb4840522b5e5a88c37ff1-1] regionserver.HStore(310): Store=8c00c428ffdb4840522b5e5a88c37ff1/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 17:54:37,105 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8c00c428ffdb4840522b5e5a88c37ff1 2023-07-11 17:54:37,105 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8c00c428ffdb4840522b5e5a88c37ff1 2023-07-11 17:54:37,108 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 8c00c428ffdb4840522b5e5a88c37ff1 2023-07-11 17:54:37,109 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8c00c428ffdb4840522b5e5a88c37ff1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 17:54:37,110 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 8c00c428ffdb4840522b5e5a88c37ff1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72428824, jitterRate=0.07927358150482178}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 17:54:37,110 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 8c00c428ffdb4840522b5e5a88c37ff1: 2023-07-11 17:54:37,111 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689098075959.8c00c428ffdb4840522b5e5a88c37ff1., pid=57, masterSystemTime=1689098077097 2023-07-11 17:54:37,112 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689098075959.8c00c428ffdb4840522b5e5a88c37ff1. 2023-07-11 17:54:37,112 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689098075959.8c00c428ffdb4840522b5e5a88c37ff1. 2023-07-11 17:54:37,113 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=56 updating hbase:meta row=8c00c428ffdb4840522b5e5a88c37ff1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:37,113 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689098075959.8c00c428ffdb4840522b5e5a88c37ff1.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1689098077113"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689098077113"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689098077113"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689098077113"}]},"ts":"1689098077113"} 2023-07-11 17:54:37,116 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=57, resume processing ppid=56 2023-07-11 17:54:37,116 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=57, ppid=56, state=SUCCESS; OpenRegionProcedure 8c00c428ffdb4840522b5e5a88c37ff1, server=jenkins-hbase9.apache.org,45839,1689097999112 in 169 msec 2023-07-11 17:54:37,117 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=56, resume processing ppid=55 2023-07-11 17:54:37,117 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=56, ppid=55, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=8c00c428ffdb4840522b5e5a88c37ff1, ASSIGN in 326 msec 2023-07-11 17:54:37,118 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-11 17:54:37,118 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689098077118"}]},"ts":"1689098077118"} 2023-07-11 17:54:37,119 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, state=ENABLED in hbase:meta 2023-07-11 17:54:37,121 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_POST_OPERATION 2023-07-11 17:54:37,122 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=55, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.1620 sec 2023-07-11 17:54:38,067 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-07-11 17:54:38,068 INFO [Listener at localhost/43271] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, procId: 55 completed 2023-07-11 17:54:38,086 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 17:54:38,089 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:38,089 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-07-11 17:54:38,089 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:54:38,089 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-07-11 17:54:38,089 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-07-11 17:54:38,089 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:38,089 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:38,091 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:54:38,091 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:38,091 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:54:38,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:54:38,091 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:38,091 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 17:54:38,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:38,091 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:38,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 17:54:38,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:38,092 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:38,092 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:38,092 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-07-11 17:54:38,092 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:54:38,092 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-07-11 17:54:38,093 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 17:54:38,093 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 17:54:38,093 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689098075959.8c00c428ffdb4840522b5e5a88c37ff1. 2023-07-11 17:54:38,094 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689098075959.8c00c428ffdb4840522b5e5a88c37ff1. started... 2023-07-11 17:54:38,094 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8c00c428ffdb4840522b5e5a88c37ff1 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-07-11 17:54:38,368 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-07-11 17:54:38,512 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130c008fc6195514d13ba63e8ff2ce9fd38 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151130c008fc6195514d13ba63e8ff2ce9fd38 2023-07-11 17:54:38,916 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8c00c428ffdb4840522b5e5a88c37ff1/.tmp/family1/3347aa96290748aa8ccd6d5bfd6df31f 2023-07-11 17:54:38,922 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8c00c428ffdb4840522b5e5a88c37ff1/.tmp/family1/3347aa96290748aa8ccd6d5bfd6df31f as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8c00c428ffdb4840522b5e5a88c37ff1/family1/3347aa96290748aa8ccd6d5bfd6df31f 2023-07-11 17:54:38,926 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8c00c428ffdb4840522b5e5a88c37ff1/family1/3347aa96290748aa8ccd6d5bfd6df31f, entries=1000, sequenceid=5, filesize=190.5 K 2023-07-11 17:54:38,927 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 8c00c428ffdb4840522b5e5a88c37ff1 in 833ms, sequenceid=5, compaction requested=false 2023-07-11 17:54:38,927 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8c00c428ffdb4840522b5e5a88c37ff1: 2023-07-11 17:54:38,927 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689098075959.8c00c428ffdb4840522b5e5a88c37ff1. 2023-07-11 17:54:38,927 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 17:54:38,927 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 17:54:38,927 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:38,928 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-07-11 17:54:38,928 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-07-11 17:54:38,929 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:38,929 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:38,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:38,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:54:38,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:54:38,929 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:38,929 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 17:54:38,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:54:38,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:54:38,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:38,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:38,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:54:38,931 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-07-11 17:54:38,931 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@aa78c[Count = 0] remaining members to acquire global barrier 2023-07-11 17:54:38,931 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-07-11 17:54:38,931 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:38,932 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:38,932 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:38,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:38,932 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-07-11 17:54:38,932 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-07-11 17:54:38,932 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase9.apache.org,45839,1689097999112' in zk 2023-07-11 17:54:38,932 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:38,932 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 17:54:38,934 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:38,934 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-07-11 17:54:38,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:38,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:54:38,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:54:38,934 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:54:38,934 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-07-11 17:54:38,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:54:38,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:54:38,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:38,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:38,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:54:38,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:38,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:38,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase9.apache.org,45839,1689097999112': 2023-07-11 17:54:38,936 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-07-11 17:54:38,936 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-07-11 17:54:38,937 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 17:54:38,937 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 17:54:38,937 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:38,937 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 17:54:38,938 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:38,938 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:38,938 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:38,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:38,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:38,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:54:38,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:54:38,938 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:54:38,938 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:54:38,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:54:38,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:54:38,939 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:38,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:38,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:38,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:54:38,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:38,940 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:38,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:38,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:54:38,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:38,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:38,944 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:54:38,944 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:38,944 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:54:38,944 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-07-11 17:54:38,944 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:54:38,944 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-07-11 17:54:38,945 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 17:54:38,944 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:54:38,944 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:38,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:54:38,945 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:38,945 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:38,945 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:38,945 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:38,945 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:38,945 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-07-11 17:54:38,945 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:54:38,945 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 17:54:38,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:54:39,045 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 17:54:39,046 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 17:54:39,050 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 17:54:39,052 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-07-11 17:54:39,052 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:39,052 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-07-11 17:54:39,052 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:54:39,052 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-07-11 17:54:39,052 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-07-11 17:54:39,052 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:39,052 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:39,055 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:39,055 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:54:39,055 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:54:39,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:54:39,055 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:39,055 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 17:54:39,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:39,056 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:39,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 17:54:39,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:39,056 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:39,056 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-07-11 17:54:39,056 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:39,056 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-07-11 17:54:39,056 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:54:39,056 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-07-11 17:54:39,057 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 17:54:39,057 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 17:54:39,057 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689098075959.8c00c428ffdb4840522b5e5a88c37ff1. 2023-07-11 17:54:39,057 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689098075959.8c00c428ffdb4840522b5e5a88c37ff1. started... 2023-07-11 17:54:39,057 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8c00c428ffdb4840522b5e5a88c37ff1 1/1 column families, dataSize=74 B heapSize=408 B 2023-07-11 17:54:39,231 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-07-11 17:54:39,471 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128e22138f4f2c04ca8b8e0410ac083185c to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151128e22138f4f2c04ca8b8e0410ac083185c 2023-07-11 17:54:39,884 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8c00c428ffdb4840522b5e5a88c37ff1/.tmp/family1/04a1e402ab5a40aa97b0c900c5ebe439 2023-07-11 17:54:39,893 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8c00c428ffdb4840522b5e5a88c37ff1/.tmp/family1/04a1e402ab5a40aa97b0c900c5ebe439 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8c00c428ffdb4840522b5e5a88c37ff1/family1/04a1e402ab5a40aa97b0c900c5ebe439 2023-07-11 17:54:39,898 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8c00c428ffdb4840522b5e5a88c37ff1/family1/04a1e402ab5a40aa97b0c900c5ebe439, entries=1, sequenceid=9, filesize=5.0 K 2023-07-11 17:54:39,899 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 8c00c428ffdb4840522b5e5a88c37ff1 in 842ms, sequenceid=9, compaction requested=false 2023-07-11 17:54:39,899 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8c00c428ffdb4840522b5e5a88c37ff1: 2023-07-11 17:54:39,899 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689098075959.8c00c428ffdb4840522b5e5a88c37ff1. 2023-07-11 17:54:39,899 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 17:54:39,899 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 17:54:39,899 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:39,899 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-07-11 17:54:39,899 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-07-11 17:54:39,901 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:39,901 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:39,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:39,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:54:39,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:54:39,901 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:39,901 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 17:54:39,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:54:39,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:54:39,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:39,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:39,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:54:39,902 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-07-11 17:54:39,902 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5a3de86e[Count = 0] remaining members to acquire global barrier 2023-07-11 17:54:39,902 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-07-11 17:54:39,902 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:39,903 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:39,903 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:39,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:39,904 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-07-11 17:54:39,904 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-07-11 17:54:39,904 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:39,904 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 17:54:39,904 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase9.apache.org,45839,1689097999112' in zk 2023-07-11 17:54:39,905 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:39,905 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-07-11 17:54:39,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:39,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:54:39,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:54:39,905 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:54:39,905 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-07-11 17:54:39,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:54:39,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:54:39,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:39,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:39,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:54:39,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:39,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:39,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase9.apache.org,45839,1689097999112': 2023-07-11 17:54:39,907 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-07-11 17:54:39,907 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-07-11 17:54:39,908 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 17:54:39,908 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 17:54:39,908 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:39,908 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 17:54:39,910 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:39,910 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:39,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:39,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:54:39,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:54:39,910 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:39,910 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:54:39,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:39,910 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:39,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:54:39,910 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:54:39,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:54:39,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:39,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:39,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:54:39,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:39,911 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:39,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:39,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:54:39,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:39,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:39,914 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:39,914 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:39,914 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:39,914 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:39,914 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:39,914 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:39,914 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:39,914 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:54:39,914 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:54:39,914 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-07-11 17:54:39,914 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 17:54:39,914 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-07-11 17:54:39,914 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:54:39,914 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:54:39,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:54:39,914 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-07-11 17:54:39,914 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 17:54:39,915 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:54:39,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:54:40,015 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 17:54:40,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 17:54:40,020 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 17:54:40,029 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-07-11 17:54:40,029 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:40,029 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-07-11 17:54:40,029 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:54:40,029 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-07-11 17:54:40,029 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-07-11 17:54:40,030 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:40,030 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:40,031 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:40,031 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:54:40,031 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:54:40,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:54:40,031 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:40,031 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 17:54:40,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:40,031 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:40,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 17:54:40,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:40,032 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:40,032 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-07-11 17:54:40,032 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:40,032 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-07-11 17:54:40,032 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:54:40,032 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-07-11 17:54:40,033 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 17:54:40,033 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689098075959.8c00c428ffdb4840522b5e5a88c37ff1. 2023-07-11 17:54:40,033 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 17:54:40,034 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689098075959.8c00c428ffdb4840522b5e5a88c37ff1. started... 2023-07-11 17:54:40,034 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8c00c428ffdb4840522b5e5a88c37ff1 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-11 17:54:40,447 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120147be1426075b45d582695cf52650b670 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015120147be1426075b45d582695cf52650b670 2023-07-11 17:54:40,852 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8c00c428ffdb4840522b5e5a88c37ff1/.tmp/family1/e8d11fe0cbc446509b676a3d2d21e384 2023-07-11 17:54:40,857 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8c00c428ffdb4840522b5e5a88c37ff1/.tmp/family1/e8d11fe0cbc446509b676a3d2d21e384 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8c00c428ffdb4840522b5e5a88c37ff1/family1/e8d11fe0cbc446509b676a3d2d21e384 2023-07-11 17:54:40,861 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8c00c428ffdb4840522b5e5a88c37ff1/family1/e8d11fe0cbc446509b676a3d2d21e384, entries=1, sequenceid=13, filesize=5.0 K 2023-07-11 17:54:40,862 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8c00c428ffdb4840522b5e5a88c37ff1 in 828ms, sequenceid=13, compaction requested=true 2023-07-11 17:54:40,862 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8c00c428ffdb4840522b5e5a88c37ff1: 2023-07-11 17:54:40,862 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689098075959.8c00c428ffdb4840522b5e5a88c37ff1. 2023-07-11 17:54:40,862 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 17:54:40,862 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 17:54:40,862 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:40,862 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-07-11 17:54:40,862 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-07-11 17:54:40,863 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:40,863 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:40,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:40,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:54:40,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:54:40,864 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:40,864 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 17:54:40,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:54:40,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:54:40,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:40,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:40,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:54:40,865 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-07-11 17:54:40,865 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3c892968[Count = 0] remaining members to acquire global barrier 2023-07-11 17:54:40,865 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-07-11 17:54:40,865 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:40,866 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:40,866 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:40,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:40,866 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-07-11 17:54:40,866 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-07-11 17:54:40,866 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase9.apache.org,45839,1689097999112' in zk 2023-07-11 17:54:40,866 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:40,866 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 17:54:40,872 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:40,872 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-07-11 17:54:40,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:40,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:54:40,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:54:40,872 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:54:40,872 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-07-11 17:54:40,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:54:40,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:54:40,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:40,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:40,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:54:40,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:40,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:40,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase9.apache.org,45839,1689097999112': 2023-07-11 17:54:40,874 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-07-11 17:54:40,874 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-07-11 17:54:40,874 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 17:54:40,874 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 17:54:40,874 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:40,874 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 17:54:40,875 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:40,875 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:40,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:40,876 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:40,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:54:40,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:54:40,876 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:54:40,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:40,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:54:40,876 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:40,876 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:54:40,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:54:40,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:40,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:40,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:54:40,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:40,877 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:40,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:40,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:54:40,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:40,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:40,879 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:40,879 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:40,879 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:40,879 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:40,879 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:40,879 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:54:40,879 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-07-11 17:54:40,879 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:54:40,879 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-07-11 17:54:40,879 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:54:40,879 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 17:54:40,879 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:40,879 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:54:40,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:54:40,879 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:40,880 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-07-11 17:54:40,880 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 17:54:40,880 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:54:40,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:54:40,980 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 17:54:40,981 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 17:54:40,984 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 17:54:40,986 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-07-11 17:54:40,986 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:40,986 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-07-11 17:54:40,986 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:54:40,986 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-07-11 17:54:40,986 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-07-11 17:54:40,987 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:40,987 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:40,988 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:40,988 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:54:40,988 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:54:40,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:54:40,988 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:40,988 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 17:54:40,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:40,989 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:40,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 17:54:40,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:40,989 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:40,989 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-07-11 17:54:40,989 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:40,989 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-07-11 17:54:40,989 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:54:40,989 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-07-11 17:54:40,990 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 17:54:40,990 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 17:54:40,990 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689098075959.8c00c428ffdb4840522b5e5a88c37ff1. 2023-07-11 17:54:40,990 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689098075959.8c00c428ffdb4840522b5e5a88c37ff1. started... 2023-07-11 17:54:40,990 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8c00c428ffdb4840522b5e5a88c37ff1 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-11 17:54:41,402 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512058a2f6ce9fbfa4c63aead1d39be28cc29 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512058a2f6ce9fbfa4c63aead1d39be28cc29 2023-07-11 17:54:41,808 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8c00c428ffdb4840522b5e5a88c37ff1/.tmp/family1/d238284aa37e4cf385bbea8899d30afd 2023-07-11 17:54:41,814 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8c00c428ffdb4840522b5e5a88c37ff1/.tmp/family1/d238284aa37e4cf385bbea8899d30afd as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8c00c428ffdb4840522b5e5a88c37ff1/family1/d238284aa37e4cf385bbea8899d30afd 2023-07-11 17:54:41,822 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8c00c428ffdb4840522b5e5a88c37ff1/family1/d238284aa37e4cf385bbea8899d30afd, entries=1, sequenceid=17, filesize=5.0 K 2023-07-11 17:54:41,823 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8c00c428ffdb4840522b5e5a88c37ff1 in 833ms, sequenceid=17, compaction requested=true 2023-07-11 17:54:41,823 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8c00c428ffdb4840522b5e5a88c37ff1: 2023-07-11 17:54:41,823 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689098075959.8c00c428ffdb4840522b5e5a88c37ff1. 2023-07-11 17:54:41,823 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 17:54:41,823 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 17:54:41,823 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:41,823 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-07-11 17:54:41,823 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-07-11 17:54:41,826 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:41,826 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:41,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:41,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:54:41,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:54:41,826 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:41,826 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 17:54:41,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:54:41,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:54:41,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:41,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:41,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:54:41,828 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-07-11 17:54:41,828 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2c35be3b[Count = 0] remaining members to acquire global barrier 2023-07-11 17:54:41,828 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-07-11 17:54:41,828 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:41,832 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:41,832 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:41,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:41,832 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-07-11 17:54:41,832 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-07-11 17:54:41,832 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase9.apache.org,45839,1689097999112' in zk 2023-07-11 17:54:41,832 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:41,833 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 17:54:41,834 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-07-11 17:54:41,834 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:54:41,834 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-07-11 17:54:41,835 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:41,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:41,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:54:41,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:54:41,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:54:41,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:54:41,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:41,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:41,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:54:41,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:41,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:41,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase9.apache.org,45839,1689097999112': 2023-07-11 17:54:41,837 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-07-11 17:54:41,837 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-07-11 17:54:41,837 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 17:54:41,837 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 17:54:41,837 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:41,837 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 17:54:41,839 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:41,839 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:41,839 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:41,839 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:54:41,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:41,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:54:41,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:54:41,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:41,840 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:41,840 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:54:41,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:54:41,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:54:41,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:41,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:41,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:54:41,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:41,841 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:41,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:41,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:54:41,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:41,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:41,845 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:41,845 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:54:41,845 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:41,845 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:54:41,845 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:41,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:54:41,845 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:54:41,845 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-07-11 17:54:41,845 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 17:54:41,845 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:54:41,845 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:41,845 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:41,845 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:41,845 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:41,845 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:54:41,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:54:41,845 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-07-11 17:54:41,845 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-07-11 17:54:41,846 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 17:54:41,946 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 17:54:41,947 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 17:54:41,951 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 17:54:41,952 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-07-11 17:54:41,953 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:41,953 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-07-11 17:54:41,953 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:54:41,953 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-07-11 17:54:41,953 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-07-11 17:54:41,953 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:41,953 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:41,955 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:54:41,955 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:54:41,955 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:41,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:54:41,955 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:41,955 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 17:54:41,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:41,956 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:41,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 17:54:41,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:41,956 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:41,956 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-07-11 17:54:41,956 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:41,956 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-07-11 17:54:41,956 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:54:41,956 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-07-11 17:54:41,956 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 17:54:41,956 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 17:54:41,957 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689098075959.8c00c428ffdb4840522b5e5a88c37ff1. 2023-07-11 17:54:41,957 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689098075959.8c00c428ffdb4840522b5e5a88c37ff1. started... 2023-07-11 17:54:41,957 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8c00c428ffdb4840522b5e5a88c37ff1 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-11 17:54:41,972 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512286573912a9a4b4fb8b7355062e0a438b6 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512286573912a9a4b4fb8b7355062e0a438b6 2023-07-11 17:54:41,980 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8c00c428ffdb4840522b5e5a88c37ff1/.tmp/family1/d85ea314d82c4430a3a7a3666f201178 2023-07-11 17:54:41,985 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8c00c428ffdb4840522b5e5a88c37ff1/.tmp/family1/d85ea314d82c4430a3a7a3666f201178 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8c00c428ffdb4840522b5e5a88c37ff1/family1/d85ea314d82c4430a3a7a3666f201178 2023-07-11 17:54:41,989 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8c00c428ffdb4840522b5e5a88c37ff1/family1/d85ea314d82c4430a3a7a3666f201178, entries=1, sequenceid=21, filesize=5.0 K 2023-07-11 17:54:41,990 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8c00c428ffdb4840522b5e5a88c37ff1 in 33ms, sequenceid=21, compaction requested=true 2023-07-11 17:54:41,990 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8c00c428ffdb4840522b5e5a88c37ff1: 2023-07-11 17:54:41,990 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689098075959.8c00c428ffdb4840522b5e5a88c37ff1. 2023-07-11 17:54:41,990 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 17:54:41,990 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 17:54:41,990 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:41,991 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-07-11 17:54:41,991 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-07-11 17:54:41,992 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:41,992 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:41,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:41,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:54:41,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:54:41,993 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:41,993 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 17:54:41,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:54:41,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:54:41,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:41,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:41,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:54:41,994 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-07-11 17:54:41,994 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@79d64af6[Count = 0] remaining members to acquire global barrier 2023-07-11 17:54:41,994 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-07-11 17:54:41,994 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:41,996 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:41,997 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:41,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:41,997 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-07-11 17:54:41,997 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-07-11 17:54:41,997 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase9.apache.org,45839,1689097999112' in zk 2023-07-11 17:54:41,997 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:41,997 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 17:54:41,998 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:41,998 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-07-11 17:54:41,998 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:54:41,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:41,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:54:41,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:54:41,998 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-07-11 17:54:42,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:54:42,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:54:42,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:42,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:42,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:54:42,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:42,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:42,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase9.apache.org,45839,1689097999112': 2023-07-11 17:54:42,003 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-07-11 17:54:42,003 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-07-11 17:54:42,003 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 17:54:42,003 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 17:54:42,003 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:42,003 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 17:54:42,005 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:42,006 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:42,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:42,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:54:42,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:54:42,006 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:42,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:42,006 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:54:42,006 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:54:42,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:54:42,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:54:42,007 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:42,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:42,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:42,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:54:42,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:42,010 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:42,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:42,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:54:42,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:42,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:42,013 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:42,013 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:54:42,013 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:42,013 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:54:42,013 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:54:42,013 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:42,014 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:54:42,014 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-07-11 17:54:42,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:54:42,014 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-07-11 17:54:42,014 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 17:54:42,014 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:42,014 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:42,014 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:42,014 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:54:42,014 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-07-11 17:54:42,014 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:42,014 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 17:54:42,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:54:42,115 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 17:54:42,116 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 17:54:42,120 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 17:54:42,128 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-07-11 17:54:42,128 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:42,128 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-07-11 17:54:42,128 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:54:42,128 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-07-11 17:54:42,128 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-07-11 17:54:42,129 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:42,129 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:42,130 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:54:42,130 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:42,131 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:54:42,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:54:42,131 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:42,131 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 17:54:42,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:42,132 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:42,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 17:54:42,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:42,132 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:42,132 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-07-11 17:54:42,132 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:42,132 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-07-11 17:54:42,132 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:54:42,132 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-07-11 17:54:42,133 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 17:54:42,133 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689098075959.8c00c428ffdb4840522b5e5a88c37ff1. 2023-07-11 17:54:42,133 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 17:54:42,133 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689098075959.8c00c428ffdb4840522b5e5a88c37ff1. started... 2023-07-11 17:54:42,133 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8c00c428ffdb4840522b5e5a88c37ff1 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-11 17:54:42,158 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015123142986551476d4bee94cffe991e5b380b to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015123142986551476d4bee94cffe991e5b380b 2023-07-11 17:54:42,170 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8c00c428ffdb4840522b5e5a88c37ff1/.tmp/family1/6ec33b2c38094bd888044dcb9463d777 2023-07-11 17:54:42,176 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8c00c428ffdb4840522b5e5a88c37ff1/.tmp/family1/6ec33b2c38094bd888044dcb9463d777 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8c00c428ffdb4840522b5e5a88c37ff1/family1/6ec33b2c38094bd888044dcb9463d777 2023-07-11 17:54:42,180 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8c00c428ffdb4840522b5e5a88c37ff1/family1/6ec33b2c38094bd888044dcb9463d777, entries=1, sequenceid=25, filesize=5.0 K 2023-07-11 17:54:42,181 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8c00c428ffdb4840522b5e5a88c37ff1 in 48ms, sequenceid=25, compaction requested=true 2023-07-11 17:54:42,181 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8c00c428ffdb4840522b5e5a88c37ff1: 2023-07-11 17:54:42,181 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689098075959.8c00c428ffdb4840522b5e5a88c37ff1. 2023-07-11 17:54:42,181 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 17:54:42,181 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 17:54:42,181 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:42,181 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-07-11 17:54:42,181 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-07-11 17:54:42,183 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:42,183 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:42,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:42,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:54:42,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:54:42,183 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:42,184 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 17:54:42,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:54:42,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:54:42,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:42,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:42,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:54:42,185 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-07-11 17:54:42,185 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4c1db33a[Count = 0] remaining members to acquire global barrier 2023-07-11 17:54:42,185 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-07-11 17:54:42,185 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:42,186 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:42,186 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:42,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:42,186 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-07-11 17:54:42,186 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-07-11 17:54:42,186 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase9.apache.org,45839,1689097999112' in zk 2023-07-11 17:54:42,187 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:42,187 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 17:54:42,189 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-07-11 17:54:42,189 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:54:42,189 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-07-11 17:54:42,192 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:42,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:42,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:54:42,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:54:42,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:54:42,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:54:42,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:42,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:42,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:54:42,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:42,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:42,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase9.apache.org,45839,1689097999112': 2023-07-11 17:54:42,195 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-07-11 17:54:42,195 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-07-11 17:54:42,195 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 17:54:42,195 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 17:54:42,195 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:42,196 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 17:54:42,197 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:42,197 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:42,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:42,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:54:42,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:54:42,197 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:42,197 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:54:42,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:42,198 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:54:42,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:54:42,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:54:42,198 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:42,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:42,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:42,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:54:42,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:42,199 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:42,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:42,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:54:42,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:42,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:42,204 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:42,204 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:42,204 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:54:42,204 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:54:42,204 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:42,204 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-07-11 17:54:42,204 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:54:42,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:54:42,204 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:54:42,204 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-07-11 17:54:42,204 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 17:54:42,204 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:42,204 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:42,204 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:42,205 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:54:42,205 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:42,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:54:42,205 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-07-11 17:54:42,205 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 17:54:42,305 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 17:54:42,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 17:54:42,309 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 17:54:42,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-07-11 17:54:42,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:42,311 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-07-11 17:54:42,311 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:54:42,311 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-07-11 17:54:42,311 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-07-11 17:54:42,312 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:42,312 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:42,317 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:54:42,317 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:42,317 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:54:42,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:54:42,317 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:42,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:42,317 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 17:54:42,317 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:42,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 17:54:42,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:42,318 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:42,318 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-07-11 17:54:42,318 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:42,318 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-07-11 17:54:42,318 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:54:42,318 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-07-11 17:54:42,318 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 17:54:42,318 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 17:54:42,318 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689098075959.8c00c428ffdb4840522b5e5a88c37ff1. 2023-07-11 17:54:42,318 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689098075959.8c00c428ffdb4840522b5e5a88c37ff1. started... 2023-07-11 17:54:42,318 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8c00c428ffdb4840522b5e5a88c37ff1 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-11 17:54:42,333 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101f70ae831463d45799f6ef7f30ac5fb49 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160101f70ae831463d45799f6ef7f30ac5fb49 2023-07-11 17:54:42,338 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8c00c428ffdb4840522b5e5a88c37ff1/.tmp/family1/2311b0c3d4244a1a884bf928abed0bcd 2023-07-11 17:54:42,342 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8c00c428ffdb4840522b5e5a88c37ff1/.tmp/family1/2311b0c3d4244a1a884bf928abed0bcd as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8c00c428ffdb4840522b5e5a88c37ff1/family1/2311b0c3d4244a1a884bf928abed0bcd 2023-07-11 17:54:42,346 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8c00c428ffdb4840522b5e5a88c37ff1/family1/2311b0c3d4244a1a884bf928abed0bcd, entries=1, sequenceid=29, filesize=5.0 K 2023-07-11 17:54:42,347 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8c00c428ffdb4840522b5e5a88c37ff1 in 29ms, sequenceid=29, compaction requested=true 2023-07-11 17:54:42,347 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8c00c428ffdb4840522b5e5a88c37ff1: 2023-07-11 17:54:42,347 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689098075959.8c00c428ffdb4840522b5e5a88c37ff1. 2023-07-11 17:54:42,347 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 17:54:42,347 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 17:54:42,347 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:42,347 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-07-11 17:54:42,347 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-07-11 17:54:42,350 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:42,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:42,350 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:42,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:54:42,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:54:42,350 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:42,350 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 17:54:42,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:54:42,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:54:42,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:42,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:42,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:54:42,351 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-07-11 17:54:42,351 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@392a11b8[Count = 0] remaining members to acquire global barrier 2023-07-11 17:54:42,351 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-07-11 17:54:42,352 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:42,353 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:42,353 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:42,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:42,353 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-07-11 17:54:42,353 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-07-11 17:54:42,353 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase9.apache.org,45839,1689097999112' in zk 2023-07-11 17:54:42,353 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:42,353 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 17:54:42,354 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:42,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:42,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:54:42,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:54:42,354 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-07-11 17:54:42,355 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:54:42,355 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-07-11 17:54:42,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:54:42,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:54:42,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:42,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:42,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:54:42,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:42,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:42,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase9.apache.org,45839,1689097999112': 2023-07-11 17:54:42,357 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-07-11 17:54:42,357 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-07-11 17:54:42,357 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 17:54:42,357 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 17:54:42,357 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:42,357 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 17:54:42,359 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:42,359 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:42,359 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:42,359 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:54:42,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:42,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:42,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:54:42,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:54:42,360 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:42,360 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:54:42,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:54:42,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:54:42,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:42,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:42,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:54:42,361 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:42,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:42,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:42,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:54:42,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:42,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:42,363 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:42,363 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:54:42,363 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:42,363 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:54:42,363 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:42,363 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-07-11 17:54:42,363 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 17:54:42,363 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:54:42,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:54:42,363 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:54:42,363 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-07-11 17:54:42,363 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:42,363 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-07-11 17:54:42,364 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:54:42,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:54:42,363 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:42,364 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 17:54:42,364 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:42,364 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:42,464 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 17:54:42,465 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 17:54:42,469 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 17:54:42,471 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-07-11 17:54:42,471 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:42,471 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-07-11 17:54:42,471 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:54:42,471 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-07-11 17:54:42,471 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-07-11 17:54:42,472 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:42,472 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:42,473 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:54:42,473 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:42,473 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:54:42,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:54:42,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:42,474 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:42,474 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 17:54:42,474 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:42,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 17:54:42,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:42,475 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:42,475 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-07-11 17:54:42,475 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:42,475 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-07-11 17:54:42,475 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:54:42,475 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-07-11 17:54:42,477 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 17:54:42,477 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 17:54:42,477 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689098075959.8c00c428ffdb4840522b5e5a88c37ff1. 2023-07-11 17:54:42,478 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689098075959.8c00c428ffdb4840522b5e5a88c37ff1. started... 2023-07-11 17:54:42,478 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8c00c428ffdb4840522b5e5a88c37ff1 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-11 17:54:42,493 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103890d5f3a49b646a2a54db768a4c37dcc to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160103890d5f3a49b646a2a54db768a4c37dcc 2023-07-11 17:54:42,507 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8c00c428ffdb4840522b5e5a88c37ff1/.tmp/family1/b2cfda47ed124fceb44054147957d4b1 2023-07-11 17:54:42,513 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8c00c428ffdb4840522b5e5a88c37ff1/.tmp/family1/b2cfda47ed124fceb44054147957d4b1 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8c00c428ffdb4840522b5e5a88c37ff1/family1/b2cfda47ed124fceb44054147957d4b1 2023-07-11 17:54:42,518 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8c00c428ffdb4840522b5e5a88c37ff1/family1/b2cfda47ed124fceb44054147957d4b1, entries=1, sequenceid=33, filesize=5.0 K 2023-07-11 17:54:42,519 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8c00c428ffdb4840522b5e5a88c37ff1 in 41ms, sequenceid=33, compaction requested=true 2023-07-11 17:54:42,519 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8c00c428ffdb4840522b5e5a88c37ff1: 2023-07-11 17:54:42,519 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689098075959.8c00c428ffdb4840522b5e5a88c37ff1. 2023-07-11 17:54:42,519 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 17:54:42,519 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 17:54:42,519 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:42,519 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-07-11 17:54:42,519 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-07-11 17:54:42,521 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:42,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:42,521 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:42,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:54:42,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:54:42,521 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:42,521 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 17:54:42,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:54:42,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:54:42,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:42,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:42,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:54:42,523 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-07-11 17:54:42,523 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@386fa4c0[Count = 0] remaining members to acquire global barrier 2023-07-11 17:54:42,523 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-07-11 17:54:42,524 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:42,526 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:42,526 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:42,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:42,526 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-07-11 17:54:42,526 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-07-11 17:54:42,526 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase9.apache.org,45839,1689097999112' in zk 2023-07-11 17:54:42,526 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:42,526 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 17:54:42,527 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:42,527 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-07-11 17:54:42,527 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:54:42,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:42,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:54:42,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:54:42,527 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-07-11 17:54:42,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:54:42,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:54:42,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:42,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:42,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:54:42,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:42,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:42,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase9.apache.org,45839,1689097999112': 2023-07-11 17:54:42,532 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-07-11 17:54:42,532 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-07-11 17:54:42,532 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 17:54:42,532 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 17:54:42,532 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:42,532 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 17:54:42,534 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:42,534 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:42,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:42,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:54:42,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:54:42,534 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:42,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:42,534 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:54:42,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:54:42,535 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:54:42,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:54:42,535 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:42,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:42,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:42,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:54:42,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:42,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:42,537 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:42,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:54:42,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:42,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:42,539 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:42,539 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:42,539 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:42,539 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:54:42,539 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:54:42,539 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:42,539 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-07-11 17:54:42,539 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 17:54:42,539 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:54:42,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:54:42,539 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:54:42,539 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:42,540 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:42,540 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:42,540 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-07-11 17:54:42,540 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 17:54:42,540 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:54:42,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:54:42,640 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 17:54:42,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 17:54:42,645 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 17:54:42,647 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-07-11 17:54:42,647 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:42,647 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-07-11 17:54:42,647 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:54:42,647 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-07-11 17:54:42,647 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-07-11 17:54:42,648 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:42,648 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:42,649 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:54:42,649 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:42,649 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:54:42,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:54:42,650 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:42,650 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 17:54:42,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:42,650 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:42,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 17:54:42,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:42,651 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:42,651 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-07-11 17:54:42,651 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:42,651 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-07-11 17:54:42,651 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:54:42,651 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-07-11 17:54:42,655 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 17:54:42,655 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 17:54:42,655 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689098075959.8c00c428ffdb4840522b5e5a88c37ff1. 2023-07-11 17:54:42,655 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689098075959.8c00c428ffdb4840522b5e5a88c37ff1. started... 2023-07-11 17:54:42,655 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8c00c428ffdb4840522b5e5a88c37ff1 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-11 17:54:43,072 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509077c5010318da741d2b91bf3a02f462ba0 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201509077c5010318da741d2b91bf3a02f462ba0 2023-07-11 17:54:43,477 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8c00c428ffdb4840522b5e5a88c37ff1/.tmp/family1/e1957acd93984172a7d2dfa3be0677f5 2023-07-11 17:54:43,482 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8c00c428ffdb4840522b5e5a88c37ff1/.tmp/family1/e1957acd93984172a7d2dfa3be0677f5 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8c00c428ffdb4840522b5e5a88c37ff1/family1/e1957acd93984172a7d2dfa3be0677f5 2023-07-11 17:54:43,487 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8c00c428ffdb4840522b5e5a88c37ff1/family1/e1957acd93984172a7d2dfa3be0677f5, entries=1, sequenceid=37, filesize=5.0 K 2023-07-11 17:54:43,487 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8c00c428ffdb4840522b5e5a88c37ff1 in 832ms, sequenceid=37, compaction requested=true 2023-07-11 17:54:43,488 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8c00c428ffdb4840522b5e5a88c37ff1: 2023-07-11 17:54:43,488 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689098075959.8c00c428ffdb4840522b5e5a88c37ff1. 2023-07-11 17:54:43,488 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 17:54:43,488 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 17:54:43,488 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:43,488 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-07-11 17:54:43,488 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-07-11 17:54:43,489 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:43,489 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:43,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:43,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:54:43,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:54:43,490 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:43,490 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 17:54:43,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:54:43,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:54:43,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:43,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:43,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:54:43,491 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-07-11 17:54:43,491 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@73a5d8c1[Count = 0] remaining members to acquire global barrier 2023-07-11 17:54:43,491 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-07-11 17:54:43,491 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:43,494 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:43,494 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:43,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:43,494 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-07-11 17:54:43,494 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-07-11 17:54:43,494 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase9.apache.org,45839,1689097999112' in zk 2023-07-11 17:54:43,494 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:43,494 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 17:54:43,495 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:43,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:43,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:54:43,495 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-07-11 17:54:43,495 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:54:43,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:54:43,495 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-07-11 17:54:43,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:54:43,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:54:43,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:43,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:43,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:54:43,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:43,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:43,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase9.apache.org,45839,1689097999112': 2023-07-11 17:54:43,498 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-07-11 17:54:43,498 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-07-11 17:54:43,498 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 17:54:43,498 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 17:54:43,498 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:43,498 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 17:54:43,500 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:43,500 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:43,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:43,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:54:43,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:54:43,500 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:43,500 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:54:43,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:43,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:54:43,500 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:54:43,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:54:43,500 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:43,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:43,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:43,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:54:43,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:43,501 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:43,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:43,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:54:43,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:43,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:43,503 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:43,504 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:54:43,504 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:43,504 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:54:43,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:54:43,504 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-07-11 17:54:43,504 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 17:54:43,504 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:43,504 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:54:43,504 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:54:43,504 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:43,504 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:43,504 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:43,504 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:43,504 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:54:43,504 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-07-11 17:54:43,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:54:43,504 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 17:54:43,604 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 17:54:43,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 17:54:43,614 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 17:54:43,615 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-07-11 17:54:43,615 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:43,615 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-07-11 17:54:43,615 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:54:43,615 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-07-11 17:54:43,615 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-07-11 17:54:43,616 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:43,616 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:43,618 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:54:43,618 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:43,618 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:54:43,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:54:43,618 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:43,618 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 17:54:43,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:43,619 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:43,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 17:54:43,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:43,619 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:43,619 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-07-11 17:54:43,619 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:43,620 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-07-11 17:54:43,620 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:54:43,620 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-07-11 17:54:43,620 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 17:54:43,620 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 17:54:43,620 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689098075959.8c00c428ffdb4840522b5e5a88c37ff1. 2023-07-11 17:54:43,620 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689098075959.8c00c428ffdb4840522b5e5a88c37ff1. started... 2023-07-11 17:54:43,620 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8c00c428ffdb4840522b5e5a88c37ff1 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-11 17:54:43,637 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511207a08e92aa7804ec7bd16b6918a67758a to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511207a08e92aa7804ec7bd16b6918a67758a 2023-07-11 17:54:44,046 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8c00c428ffdb4840522b5e5a88c37ff1/.tmp/family1/93203721371c4583a2261be6f99ac0d9 2023-07-11 17:54:44,052 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8c00c428ffdb4840522b5e5a88c37ff1/.tmp/family1/93203721371c4583a2261be6f99ac0d9 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8c00c428ffdb4840522b5e5a88c37ff1/family1/93203721371c4583a2261be6f99ac0d9 2023-07-11 17:54:44,056 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8c00c428ffdb4840522b5e5a88c37ff1/family1/93203721371c4583a2261be6f99ac0d9, entries=1, sequenceid=41, filesize=5.0 K 2023-07-11 17:54:44,057 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8c00c428ffdb4840522b5e5a88c37ff1 in 437ms, sequenceid=41, compaction requested=true 2023-07-11 17:54:44,057 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8c00c428ffdb4840522b5e5a88c37ff1: 2023-07-11 17:54:44,058 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689098075959.8c00c428ffdb4840522b5e5a88c37ff1. 2023-07-11 17:54:44,058 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 17:54:44,058 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 17:54:44,058 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:44,058 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-07-11 17:54:44,058 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-07-11 17:54:44,059 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:44,059 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:44,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:44,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:54:44,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:54:44,060 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:44,060 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 17:54:44,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:54:44,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:54:44,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:44,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:44,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:54:44,061 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-07-11 17:54:44,061 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@528031ec[Count = 0] remaining members to acquire global barrier 2023-07-11 17:54:44,061 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-07-11 17:54:44,061 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:44,062 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:44,062 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:44,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:44,062 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-07-11 17:54:44,062 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-07-11 17:54:44,062 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase9.apache.org,45839,1689097999112' in zk 2023-07-11 17:54:44,062 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:44,062 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 17:54:44,063 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-07-11 17:54:44,063 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:44,063 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:54:44,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:44,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:54:44,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:54:44,063 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-07-11 17:54:44,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:54:44,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:54:44,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:44,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:44,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:54:44,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:44,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:44,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase9.apache.org,45839,1689097999112': 2023-07-11 17:54:44,066 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-07-11 17:54:44,066 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-07-11 17:54:44,066 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 17:54:44,066 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 17:54:44,066 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:44,066 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 17:54:44,068 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:44,068 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:54:44,068 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:44,068 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:44,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:44,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:54:44,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:54:44,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:44,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:54:44,069 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:54:44,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:54:44,069 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:44,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:44,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:44,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:54:44,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:44,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:44,070 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:44,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:54:44,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:44,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:44,072 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:44,072 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:44,072 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:44,072 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:44,072 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:54:44,072 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:54:44,072 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:54:44,072 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-07-11 17:54:44,072 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:54:44,072 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-07-11 17:54:44,072 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 17:54:44,072 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:44,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:54:44,072 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:44,072 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:44,072 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-07-11 17:54:44,072 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:54:44,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:54:44,073 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 17:54:44,173 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 17:54:44,174 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 17:54:44,175 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=36885] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:44,176 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] procedure2.ProcedureExecutor(1029): Stored pid=58, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-07-11 17:54:44,177 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=58, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-07-11 17:54:44,177 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-07-11 17:54:44,178 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=58, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1689098684177 2023-07-11 17:54:44,178 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-07-11 17:54:44,179 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-07-11 17:54:44,179 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-07-11 17:54:44,180 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] zookeeper.ReadOnlyZKClient(139): Connect 0x789f1321 to 127.0.0.1:50702 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 17:54:44,184 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@66f6215d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 17:54:44,185 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-07-11 17:54:45,021 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103437d11ff5cf64b7e9ee6509d82987920 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160103437d11ff5cf64b7e9ee6509d82987920 2023-07-11 17:54:45,022 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-07-11 17:54:45,036 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 17:54:45,037 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:33704, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 17:54:45,044 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-11 17:54:45,045 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:56658, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-11 17:54:45,054 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/1d0b35034ded43f5ba079160af5635ff first=Optional[r3] last=Optional[r6] 2023-07-11 17:54:45,055 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689098075959.8c00c428ffdb4840522b5e5a88c37ff1., hostname=jenkins-hbase9.apache.org,45839,1689097999112, seqNum=2 for row with hfile group [{family1,hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/1d0b35034ded43f5ba079160af5635ff}] 2023-07-11 17:54:45,059 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(763): Validating hfile at hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/1d0b35034ded43f5ba079160af5635ff for inclusion in 8c00c428ffdb4840522b5e5a88c37ff1/family1 2023-07-11 17:54:45,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-07-11 17:54:45,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(777): Region bounds: first= last= 2023-07-11 17:54:45,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HRegion(2446): Flush status journal for 8c00c428ffdb4840522b5e5a88c37ff1: 2023-07-11 17:54:45,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/1d0b35034ded43f5ba079160af5635ff to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__s3j8o7obetboo6vtct8amn45vb4grpff6hlc3nor22qvan0bb872qimsgf73jjqi/family1/1d0b35034ded43f5ba079160af5635ff 2023-07-11 17:54:45,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__s3j8o7obetboo6vtct8amn45vb4grpff6hlc3nor22qvan0bb872qimsgf73jjqi/family1/1d0b35034ded43f5ba079160af5635ff as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8c00c428ffdb4840522b5e5a88c37ff1/family1/d4101cc4da6a41869ce3926374d0bd1e_SeqId_44_ 2023-07-11 17:54:45,065 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(849): Loaded HFile hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__s3j8o7obetboo6vtct8amn45vb4grpff6hlc3nor22qvan0bb872qimsgf73jjqi/family1/1d0b35034ded43f5ba079160af5635ff into 8c00c428ffdb4840522b5e5a88c37ff1/family1 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8c00c428ffdb4840522b5e5a88c37ff1/family1/d4101cc4da6a41869ce3926374d0bd1e_SeqId_44_ - updating store file list. 2023-07-11 17:54:45,069 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(882): Loaded HFile hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8c00c428ffdb4840522b5e5a88c37ff1/family1/d4101cc4da6a41869ce3926374d0bd1e_SeqId_44_ into 8c00c428ffdb4840522b5e5a88c37ff1/family1 2023-07-11 17:54:45,069 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(855): Successfully loaded hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__s3j8o7obetboo6vtct8amn45vb4grpff6hlc3nor22qvan0bb872qimsgf73jjqi/family1/1d0b35034ded43f5ba079160af5635ff into 8c00c428ffdb4840522b5e5a88c37ff1/family1 (new location: hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8c00c428ffdb4840522b5e5a88c37ff1/family1/d4101cc4da6a41869ce3926374d0bd1e_SeqId_44_) 2023-07-11 17:54:45,069 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__s3j8o7obetboo6vtct8amn45vb4grpff6hlc3nor22qvan0bb872qimsgf73jjqi/family1/1d0b35034ded43f5ba079160af5635ff 2023-07-11 17:54:45,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-07-11 17:54:45,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51552 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-07-11 17:54:45,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(1912): 8c00c428ffdb4840522b5e5a88c37ff1/family1 is initiating minor compaction 2023-07-11 17:54:45,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@7768b6c2; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-11 17:54:45,073 INFO [RS:0;jenkins-hbase9:45839-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 8c00c428ffdb4840522b5e5a88c37ff1/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689098075959.8c00c428ffdb4840522b5e5a88c37ff1. 2023-07-11 17:54:45,073 INFO [RS:0;jenkins-hbase9:45839-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8c00c428ffdb4840522b5e5a88c37ff1/family1/04a1e402ab5a40aa97b0c900c5ebe439, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8c00c428ffdb4840522b5e5a88c37ff1/family1/e8d11fe0cbc446509b676a3d2d21e384, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8c00c428ffdb4840522b5e5a88c37ff1/family1/d238284aa37e4cf385bbea8899d30afd, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8c00c428ffdb4840522b5e5a88c37ff1/family1/d85ea314d82c4430a3a7a3666f201178, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8c00c428ffdb4840522b5e5a88c37ff1/family1/6ec33b2c38094bd888044dcb9463d777, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8c00c428ffdb4840522b5e5a88c37ff1/family1/2311b0c3d4244a1a884bf928abed0bcd, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8c00c428ffdb4840522b5e5a88c37ff1/family1/b2cfda47ed124fceb44054147957d4b1, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8c00c428ffdb4840522b5e5a88c37ff1/family1/e1957acd93984172a7d2dfa3be0677f5, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8c00c428ffdb4840522b5e5a88c37ff1/family1/93203721371c4583a2261be6f99ac0d9, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8c00c428ffdb4840522b5e5a88c37ff1/family1/d4101cc4da6a41869ce3926374d0bd1e_SeqId_44_] into tmpdir=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8c00c428ffdb4840522b5e5a88c37ff1/.tmp, totalSize=50.3 K 2023-07-11 17:54:45,073 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] compactions.Compactor(207): Compacting 04a1e402ab5a40aa97b0c900c5ebe439, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-07-11 17:54:45,073 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] compactions.Compactor(207): Compacting e8d11fe0cbc446509b676a3d2d21e384, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-07-11 17:54:45,073 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] compactions.Compactor(207): Compacting d238284aa37e4cf385bbea8899d30afd, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-07-11 17:54:45,073 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] compactions.Compactor(207): Compacting d85ea314d82c4430a3a7a3666f201178, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-07-11 17:54:45,073 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] compactions.Compactor(207): Compacting 6ec33b2c38094bd888044dcb9463d777, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-07-11 17:54:45,074 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] compactions.Compactor(207): Compacting 2311b0c3d4244a1a884bf928abed0bcd, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-07-11 17:54:45,074 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] compactions.Compactor(207): Compacting b2cfda47ed124fceb44054147957d4b1, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-07-11 17:54:45,074 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] compactions.Compactor(207): Compacting e1957acd93984172a7d2dfa3be0677f5, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-07-11 17:54:45,074 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] compactions.Compactor(207): Compacting 93203721371c4583a2261be6f99ac0d9, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-07-11 17:54:45,074 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] compactions.Compactor(207): Compacting d4101cc4da6a41869ce3926374d0bd1e_SeqId_44_, keycount=4, bloomtype=ROW, size=5.6 K, encoding=NONE, compression=NONE, seqNum=45 2023-07-11 17:54:45,075 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-07-11 17:54:45,076 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 17:54:45,080 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512286573912a9a4b4fb8b7355062e0a438b6 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512286573912a9a4b4fb8b7355062e0a438b6 2023-07-11 17:54:45,081 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015123142986551476d4bee94cffe991e5b380b to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015123142986551476d4bee94cffe991e5b380b 2023-07-11 17:54:45,082 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160101f70ae831463d45799f6ef7f30ac5fb49 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160101f70ae831463d45799f6ef7f30ac5fb49 2023-07-11 17:54:45,084 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160103890d5f3a49b646a2a54db768a4c37dcc to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160103890d5f3a49b646a2a54db768a4c37dcc 2023-07-11 17:54:45,084 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 4 expired mob files are deleted 2023-07-11 17:54:45,084 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-07-11 17:54:45,084 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-07-11 17:54:45,084 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-07-11 17:54:45,084 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-07-11 17:54:45,084 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-07-11 17:54:45,085 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-07-11 17:54:45,085 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-07-11 17:54:45,085 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-07-11 17:54:45,085 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-07-11 17:54:45,109 INFO [RS:0;jenkins-hbase9:45839-shortCompactions-0] throttle.PressureAwareThroughputController(145): 8c00c428ffdb4840522b5e5a88c37ff1#family1#compaction#72 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-11 17:54:45,929 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8c00c428ffdb4840522b5e5a88c37ff1/.tmp/family1/0cced5763ef84dc8971c35f31ac9f8ff as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8c00c428ffdb4840522b5e5a88c37ff1/family1/0cced5763ef84dc8971c35f31ac9f8ff 2023-07-11 17:54:45,935 INFO [RS:0;jenkins-hbase9:45839-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 8c00c428ffdb4840522b5e5a88c37ff1/family1 of 8c00c428ffdb4840522b5e5a88c37ff1 into 0cced5763ef84dc8971c35f31ac9f8ff(size=6.8 K), total size for store is 197.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-11 17:54:45,935 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 8c00c428ffdb4840522b5e5a88c37ff1: 2023-07-11 17:54:45,935 INFO [RS:0;jenkins-hbase9:45839-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689098075959.8c00c428ffdb4840522b5e5a88c37ff1., storeName=family1, fileCount=10, fileSize=50.3 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.6 K), priority=2, time=1689098085073; duration=0sec 2023-07-11 17:54:45,935 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-11 17:54:45,936 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205caf9cda2750e4ce898a94c230fb7f283 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151205caf9cda2750e4ce898a94c230fb7f283 2023-07-11 17:54:45,937 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-07-11 17:54:45,959 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8c00c428ffdb4840522b5e5a88c37ff1/family1/04a1e402ab5a40aa97b0c900c5ebe439, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8c00c428ffdb4840522b5e5a88c37ff1/family1/e8d11fe0cbc446509b676a3d2d21e384, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8c00c428ffdb4840522b5e5a88c37ff1/family1/d238284aa37e4cf385bbea8899d30afd, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8c00c428ffdb4840522b5e5a88c37ff1/family1/d85ea314d82c4430a3a7a3666f201178, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8c00c428ffdb4840522b5e5a88c37ff1/family1/6ec33b2c38094bd888044dcb9463d777, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8c00c428ffdb4840522b5e5a88c37ff1/family1/2311b0c3d4244a1a884bf928abed0bcd, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8c00c428ffdb4840522b5e5a88c37ff1/family1/b2cfda47ed124fceb44054147957d4b1, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8c00c428ffdb4840522b5e5a88c37ff1/family1/e1957acd93984172a7d2dfa3be0677f5, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8c00c428ffdb4840522b5e5a88c37ff1/family1/93203721371c4583a2261be6f99ac0d9, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8c00c428ffdb4840522b5e5a88c37ff1/family1/d4101cc4da6a41869ce3926374d0bd1e_SeqId_44_] to archive 2023-07-11 17:54:45,960 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 17:54:45,963 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8c00c428ffdb4840522b5e5a88c37ff1/family1/04a1e402ab5a40aa97b0c900c5ebe439 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8c00c428ffdb4840522b5e5a88c37ff1/family1/04a1e402ab5a40aa97b0c900c5ebe439 2023-07-11 17:54:45,968 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8c00c428ffdb4840522b5e5a88c37ff1/family1/e8d11fe0cbc446509b676a3d2d21e384 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8c00c428ffdb4840522b5e5a88c37ff1/family1/e8d11fe0cbc446509b676a3d2d21e384 2023-07-11 17:54:45,969 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8c00c428ffdb4840522b5e5a88c37ff1/family1/d238284aa37e4cf385bbea8899d30afd to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8c00c428ffdb4840522b5e5a88c37ff1/family1/d238284aa37e4cf385bbea8899d30afd 2023-07-11 17:54:45,971 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8c00c428ffdb4840522b5e5a88c37ff1/family1/d85ea314d82c4430a3a7a3666f201178 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8c00c428ffdb4840522b5e5a88c37ff1/family1/d85ea314d82c4430a3a7a3666f201178 2023-07-11 17:54:45,973 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8c00c428ffdb4840522b5e5a88c37ff1/family1/6ec33b2c38094bd888044dcb9463d777 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8c00c428ffdb4840522b5e5a88c37ff1/family1/6ec33b2c38094bd888044dcb9463d777 2023-07-11 17:54:45,976 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8c00c428ffdb4840522b5e5a88c37ff1/family1/2311b0c3d4244a1a884bf928abed0bcd to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8c00c428ffdb4840522b5e5a88c37ff1/family1/2311b0c3d4244a1a884bf928abed0bcd 2023-07-11 17:54:45,978 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8c00c428ffdb4840522b5e5a88c37ff1/family1/b2cfda47ed124fceb44054147957d4b1 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8c00c428ffdb4840522b5e5a88c37ff1/family1/b2cfda47ed124fceb44054147957d4b1 2023-07-11 17:54:45,979 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/fae9522c49d849568ae9d9cd367643f2 first=Optional[r00] last=Optional[r2] 2023-07-11 17:54:45,980 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689098075959.8c00c428ffdb4840522b5e5a88c37ff1., hostname=jenkins-hbase9.apache.org,45839,1689097999112, seqNum=2 for row with hfile group [{family1,hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/fae9522c49d849568ae9d9cd367643f2}] 2023-07-11 17:54:45,980 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8c00c428ffdb4840522b5e5a88c37ff1/family1/e1957acd93984172a7d2dfa3be0677f5 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8c00c428ffdb4840522b5e5a88c37ff1/family1/e1957acd93984172a7d2dfa3be0677f5 2023-07-11 17:54:45,982 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8c00c428ffdb4840522b5e5a88c37ff1/family1/93203721371c4583a2261be6f99ac0d9 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8c00c428ffdb4840522b5e5a88c37ff1/family1/93203721371c4583a2261be6f99ac0d9 2023-07-11 17:54:45,983 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(763): Validating hfile at hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/fae9522c49d849568ae9d9cd367643f2 for inclusion in 8c00c428ffdb4840522b5e5a88c37ff1/family1 2023-07-11 17:54:45,983 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8c00c428ffdb4840522b5e5a88c37ff1/family1/d4101cc4da6a41869ce3926374d0bd1e_SeqId_44_ to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8c00c428ffdb4840522b5e5a88c37ff1/family1/d4101cc4da6a41869ce3926374d0bd1e_SeqId_44_ 2023-07-11 17:54:45,986 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-07-11 17:54:45,986 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(777): Region bounds: first= last= 2023-07-11 17:54:45,986 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HRegion(2446): Flush status journal for 8c00c428ffdb4840522b5e5a88c37ff1: 2023-07-11 17:54:45,987 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/fae9522c49d849568ae9d9cd367643f2 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__s2s2olqqsu7pf23vtfs1ribp9ptk3qoml6vufd24c6srphooro3ju4jcv3pphm23/family1/fae9522c49d849568ae9d9cd367643f2 2023-07-11 17:54:45,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__s2s2olqqsu7pf23vtfs1ribp9ptk3qoml6vufd24c6srphooro3ju4jcv3pphm23/family1/fae9522c49d849568ae9d9cd367643f2 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8c00c428ffdb4840522b5e5a88c37ff1/family1/5f41bbf65a1d4c08ab02f99288cf0943_SeqId_47_ 2023-07-11 17:54:45,990 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(849): Loaded HFile hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__s2s2olqqsu7pf23vtfs1ribp9ptk3qoml6vufd24c6srphooro3ju4jcv3pphm23/family1/fae9522c49d849568ae9d9cd367643f2 into 8c00c428ffdb4840522b5e5a88c37ff1/family1 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8c00c428ffdb4840522b5e5a88c37ff1/family1/5f41bbf65a1d4c08ab02f99288cf0943_SeqId_47_ - updating store file list. 2023-07-11 17:54:45,995 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(882): Loaded HFile hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8c00c428ffdb4840522b5e5a88c37ff1/family1/5f41bbf65a1d4c08ab02f99288cf0943_SeqId_47_ into 8c00c428ffdb4840522b5e5a88c37ff1/family1 2023-07-11 17:54:45,995 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(855): Successfully loaded hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__s2s2olqqsu7pf23vtfs1ribp9ptk3qoml6vufd24c6srphooro3ju4jcv3pphm23/family1/fae9522c49d849568ae9d9cd367643f2 into 8c00c428ffdb4840522b5e5a88c37ff1/family1 (new location: hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8c00c428ffdb4840522b5e5a88c37ff1/family1/5f41bbf65a1d4c08ab02f99288cf0943_SeqId_47_) 2023-07-11 17:54:45,996 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__s2s2olqqsu7pf23vtfs1ribp9ptk3qoml6vufd24c6srphooro3ju4jcv3pphm23/family1/fae9522c49d849568ae9d9cd367643f2 2023-07-11 17:54:45,996 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-07-11 17:54:45,997 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 397422 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-07-11 17:54:45,997 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(1912): 8c00c428ffdb4840522b5e5a88c37ff1/family1 is initiating minor compaction (all files) 2023-07-11 17:54:45,998 INFO [RS:0;jenkins-hbase9:45839-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 8c00c428ffdb4840522b5e5a88c37ff1/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689098075959.8c00c428ffdb4840522b5e5a88c37ff1. 2023-07-11 17:54:45,998 INFO [RS:0;jenkins-hbase9:45839-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8c00c428ffdb4840522b5e5a88c37ff1/family1/3347aa96290748aa8ccd6d5bfd6df31f, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8c00c428ffdb4840522b5e5a88c37ff1/family1/0cced5763ef84dc8971c35f31ac9f8ff, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8c00c428ffdb4840522b5e5a88c37ff1/family1/5f41bbf65a1d4c08ab02f99288cf0943_SeqId_47_] into tmpdir=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8c00c428ffdb4840522b5e5a88c37ff1/.tmp, totalSize=388.1 K 2023-07-11 17:54:45,998 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@48663fc8; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-11 17:54:45,998 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] compactions.Compactor(207): Compacting 3347aa96290748aa8ccd6d5bfd6df31f, keycount=1000, bloomtype=ROW, size=190.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878822106 2023-07-11 17:54:45,999 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] compactions.Compactor(207): Compacting 0cced5763ef84dc8971c35f31ac9f8ff, keycount=9, bloomtype=ROW, size=6.8 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621222106 2023-07-11 17:54:45,999 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] compactions.Compactor(207): Compacting 5f41bbf65a1d4c08ab02f99288cf0943_SeqId_47_, keycount=1002, bloomtype=ROW, size=190.9 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878822106 2023-07-11 17:54:46,001 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-07-11 17:54:46,002 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 17:54:46,004 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151130c008fc6195514d13ba63e8ff2ce9fd38 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151130c008fc6195514d13ba63e8ff2ce9fd38 2023-07-11 17:54:46,005 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015120147be1426075b45d582695cf52650b670 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015120147be1426075b45d582695cf52650b670 2023-07-11 17:54:46,006 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512058a2f6ce9fbfa4c63aead1d39be28cc29 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512058a2f6ce9fbfa4c63aead1d39be28cc29 2023-07-11 17:54:46,006 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 3 expired mob files are deleted 2023-07-11 17:54:46,006 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-07-11 17:54:46,007 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-07-11 17:54:46,007 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-07-11 17:54:46,007 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-07-11 17:54:46,008 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=58, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-07-11 17:54:46,010 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=58, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 1.8340 sec 2023-07-11 17:54:46,023 INFO [RS:0;jenkins-hbase9:45839-shortCompactions-0] throttle.PressureAwareThroughputController(145): 8c00c428ffdb4840522b5e5a88c37ff1#family1#compaction#73 average throughput is 19.96 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-11 17:54:46,105 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.HMaster$12(2454): Client=jenkins//172.31.2.10 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-07-11 17:54:46,106 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure2.ProcedureExecutor(1029): Stored pid=59, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:46,524 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-07-11 17:54:46,524 DEBUG [PEWorker-4] util.FSTableDescriptors(519): Deleted hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000001 2023-07-11 17:54:46,525 INFO [PEWorker-4] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-07-11 17:54:46,527 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily}] 2023-07-11 17:54:46,529 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=8c00c428ffdb4840522b5e5a88c37ff1, REOPEN/MOVE}] 2023-07-11 17:54:46,530 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=8c00c428ffdb4840522b5e5a88c37ff1, REOPEN/MOVE 2023-07-11 17:54:46,530 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=8c00c428ffdb4840522b5e5a88c37ff1, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:46,530 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689098075959.8c00c428ffdb4840522b5e5a88c37ff1.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1689098086530"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689098086530"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689098086530"}]},"ts":"1689098086530"} 2023-07-11 17:54:46,532 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=62, ppid=61, state=RUNNABLE; CloseRegionProcedure 8c00c428ffdb4840522b5e5a88c37ff1, server=jenkins-hbase9.apache.org,45839,1689097999112}] 2023-07-11 17:54:46,683 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 8c00c428ffdb4840522b5e5a88c37ff1 2023-07-11 17:54:46,683 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 8c00c428ffdb4840522b5e5a88c37ff1, disabling compactions & flushes 2023-07-11 17:54:46,683 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1858): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689098075959.8c00c428ffdb4840522b5e5a88c37ff1. 2023-07-11 17:54:47,243 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8c00c428ffdb4840522b5e5a88c37ff1/.tmp/family1/99ba9dbfc9054c40a50cd3763bd5f3bb as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8c00c428ffdb4840522b5e5a88c37ff1/family1/99ba9dbfc9054c40a50cd3763bd5f3bb 2023-07-11 17:54:47,248 INFO [RS:0;jenkins-hbase9:45839-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 8c00c428ffdb4840522b5e5a88c37ff1/family1 of 8c00c428ffdb4840522b5e5a88c37ff1 into 99ba9dbfc9054c40a50cd3763bd5f3bb(size=192.0 K), total size for store is 192.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-07-11 17:54:47,248 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 8c00c428ffdb4840522b5e5a88c37ff1: 2023-07-11 17:54:47,248 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689098075959.8c00c428ffdb4840522b5e5a88c37ff1. 2023-07-11 17:54:47,248 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689098075959.8c00c428ffdb4840522b5e5a88c37ff1. 2023-07-11 17:54:47,248 INFO [RS:0;jenkins-hbase9:45839-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689098075959.8c00c428ffdb4840522b5e5a88c37ff1., storeName=family1, fileCount=3, fileSize=388.1 K (190.5 K, 6.8 K, 190.9 K), priority=2, time=1689098085997; duration=1sec 2023-07-11 17:54:47,248 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689098075959.8c00c428ffdb4840522b5e5a88c37ff1. after waiting 0 ms 2023-07-11 17:54:47,248 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-11 17:54:47,248 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689098075959.8c00c428ffdb4840522b5e5a88c37ff1. 2023-07-11 17:54:47,251 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689098075959.8c00c428ffdb4840522b5e5a88c37ff1.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8c00c428ffdb4840522b5e5a88c37ff1/family1/3347aa96290748aa8ccd6d5bfd6df31f, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8c00c428ffdb4840522b5e5a88c37ff1/family1/0cced5763ef84dc8971c35f31ac9f8ff, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8c00c428ffdb4840522b5e5a88c37ff1/family1/5f41bbf65a1d4c08ab02f99288cf0943_SeqId_47_] to archive 2023-07-11 17:54:47,252 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689098075959.8c00c428ffdb4840522b5e5a88c37ff1.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 17:54:47,253 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689098075959.8c00c428ffdb4840522b5e5a88c37ff1.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8c00c428ffdb4840522b5e5a88c37ff1/family1/3347aa96290748aa8ccd6d5bfd6df31f to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8c00c428ffdb4840522b5e5a88c37ff1/family1/3347aa96290748aa8ccd6d5bfd6df31f 2023-07-11 17:54:47,255 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689098075959.8c00c428ffdb4840522b5e5a88c37ff1.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8c00c428ffdb4840522b5e5a88c37ff1/family1/0cced5763ef84dc8971c35f31ac9f8ff to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8c00c428ffdb4840522b5e5a88c37ff1/family1/0cced5763ef84dc8971c35f31ac9f8ff 2023-07-11 17:54:47,256 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689098075959.8c00c428ffdb4840522b5e5a88c37ff1.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8c00c428ffdb4840522b5e5a88c37ff1/family1/5f41bbf65a1d4c08ab02f99288cf0943_SeqId_47_ to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8c00c428ffdb4840522b5e5a88c37ff1/family1/5f41bbf65a1d4c08ab02f99288cf0943_SeqId_47_ 2023-07-11 17:54:47,260 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8c00c428ffdb4840522b5e5a88c37ff1/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-07-11 17:54:47,261 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689098075959.8c00c428ffdb4840522b5e5a88c37ff1. 2023-07-11 17:54:47,261 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 8c00c428ffdb4840522b5e5a88c37ff1: 2023-07-11 17:54:47,261 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(3510): Not adding moved region record: 8c00c428ffdb4840522b5e5a88c37ff1 to self. 2023-07-11 17:54:47,262 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 8c00c428ffdb4840522b5e5a88c37ff1 2023-07-11 17:54:47,263 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=8c00c428ffdb4840522b5e5a88c37ff1, regionState=CLOSED 2023-07-11 17:54:47,263 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689098075959.8c00c428ffdb4840522b5e5a88c37ff1.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1689098087263"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689098087263"}]},"ts":"1689098087263"} 2023-07-11 17:54:47,265 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=62, resume processing ppid=61 2023-07-11 17:54:47,265 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=62, ppid=61, state=SUCCESS; CloseRegionProcedure 8c00c428ffdb4840522b5e5a88c37ff1, server=jenkins-hbase9.apache.org,45839,1689097999112 in 732 msec 2023-07-11 17:54:47,265 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=8c00c428ffdb4840522b5e5a88c37ff1, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase9.apache.org,45839,1689097999112; forceNewPlan=false, retain=true 2023-07-11 17:54:47,416 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=8c00c428ffdb4840522b5e5a88c37ff1, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:47,416 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689098075959.8c00c428ffdb4840522b5e5a88c37ff1.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1689098087416"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689098087416"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689098087416"}]},"ts":"1689098087416"} 2023-07-11 17:54:47,417 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=63, ppid=61, state=RUNNABLE; OpenRegionProcedure 8c00c428ffdb4840522b5e5a88c37ff1, server=jenkins-hbase9.apache.org,45839,1689097999112}] 2023-07-11 17:54:47,571 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689098075959.8c00c428ffdb4840522b5e5a88c37ff1. 2023-07-11 17:54:47,572 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8c00c428ffdb4840522b5e5a88c37ff1, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689098075959.8c00c428ffdb4840522b5e5a88c37ff1.', STARTKEY => '', ENDKEY => ''} 2023-07-11 17:54:47,572 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 8c00c428ffdb4840522b5e5a88c37ff1 2023-07-11 17:54:47,572 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689098075959.8c00c428ffdb4840522b5e5a88c37ff1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 17:54:47,572 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 8c00c428ffdb4840522b5e5a88c37ff1 2023-07-11 17:54:47,572 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 8c00c428ffdb4840522b5e5a88c37ff1 2023-07-11 17:54:47,573 INFO [StoreOpener-8c00c428ffdb4840522b5e5a88c37ff1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 8c00c428ffdb4840522b5e5a88c37ff1 2023-07-11 17:54:47,574 DEBUG [StoreOpener-8c00c428ffdb4840522b5e5a88c37ff1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8c00c428ffdb4840522b5e5a88c37ff1/family1 2023-07-11 17:54:47,574 DEBUG [StoreOpener-8c00c428ffdb4840522b5e5a88c37ff1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8c00c428ffdb4840522b5e5a88c37ff1/family1 2023-07-11 17:54:47,574 INFO [StoreOpener-8c00c428ffdb4840522b5e5a88c37ff1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8c00c428ffdb4840522b5e5a88c37ff1 columnFamilyName family1 2023-07-11 17:54:47,579 DEBUG [StoreOpener-8c00c428ffdb4840522b5e5a88c37ff1-1] regionserver.HStore(539): loaded hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8c00c428ffdb4840522b5e5a88c37ff1/family1/99ba9dbfc9054c40a50cd3763bd5f3bb 2023-07-11 17:54:47,579 INFO [StoreOpener-8c00c428ffdb4840522b5e5a88c37ff1-1] regionserver.HStore(310): Store=8c00c428ffdb4840522b5e5a88c37ff1/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 17:54:47,580 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8c00c428ffdb4840522b5e5a88c37ff1 2023-07-11 17:54:47,581 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8c00c428ffdb4840522b5e5a88c37ff1 2023-07-11 17:54:47,585 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 8c00c428ffdb4840522b5e5a88c37ff1 2023-07-11 17:54:47,585 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 8c00c428ffdb4840522b5e5a88c37ff1; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68817797, jitterRate=0.025465086102485657}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 17:54:47,585 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 8c00c428ffdb4840522b5e5a88c37ff1: 2023-07-11 17:54:47,586 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689098075959.8c00c428ffdb4840522b5e5a88c37ff1., pid=63, masterSystemTime=1689098087569 2023-07-11 17:54:47,587 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689098075959.8c00c428ffdb4840522b5e5a88c37ff1. 2023-07-11 17:54:47,587 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689098075959.8c00c428ffdb4840522b5e5a88c37ff1. 2023-07-11 17:54:47,587 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=8c00c428ffdb4840522b5e5a88c37ff1, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:47,588 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689098075959.8c00c428ffdb4840522b5e5a88c37ff1.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1689098087587"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689098087587"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689098087587"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689098087587"}]},"ts":"1689098087587"} 2023-07-11 17:54:47,590 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=63, resume processing ppid=61 2023-07-11 17:54:47,590 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=63, ppid=61, state=SUCCESS; OpenRegionProcedure 8c00c428ffdb4840522b5e5a88c37ff1, server=jenkins-hbase9.apache.org,45839,1689097999112 in 172 msec 2023-07-11 17:54:47,591 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=60 2023-07-11 17:54:47,591 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=60, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=8c00c428ffdb4840522b5e5a88c37ff1, REOPEN/MOVE in 1.0610 sec 2023-07-11 17:54:47,593 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=59 2023-07-11 17:54:47,593 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=59, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.0650 sec 2023-07-11 17:54:47,595 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=59, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.4880 sec 2023-07-11 17:54:47,595 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1230): Checking to see if procedure is done pid=59 2023-07-11 17:54:47,597 INFO [Listener at localhost/43271] compactions.TestMobCompactor(278): alter status finished 2023-07-11 17:54:47,597 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=36885] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:47,598 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-07-11 17:54:47,599 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-07-11 17:54:47,600 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-07-11 17:54:47,600 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1689098687600 2023-07-11 17:54:47,600 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-07-11 17:54:47,601 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-07-11 17:54:47,601 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-07-11 17:54:47,601 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] zookeeper.ReadOnlyZKClient(139): Connect 0x79071bf3 to 127.0.0.1:50702 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 17:54:47,605 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2463a63b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 17:54:47,605 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-07-11 17:54:47,605 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-07-11 17:54:47,605 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-07-11 17:54:47,605 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-07-11 17:54:47,605 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-07-11 17:54:48,435 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128e48a1ea7430e4806838d9cefea085df9 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151128e48a1ea7430e4806838d9cefea085df9 2023-07-11 17:54:48,436 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-07-11 17:54:48,449 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 17:54:48,451 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:33710, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 17:54:48,470 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-11 17:54:48,473 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:56664, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-11 17:54:48,492 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/31507ac3c1434c87867ee52f542d0544 first=Optional[r05] last=Optional[r8] 2023-07-11 17:54:48,493 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689098075959.8c00c428ffdb4840522b5e5a88c37ff1., hostname=jenkins-hbase9.apache.org,45839,1689097999112, seqNum=51 for row with hfile group [{family1,hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/31507ac3c1434c87867ee52f542d0544}] 2023-07-11 17:54:48,498 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(763): Validating hfile at hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/31507ac3c1434c87867ee52f542d0544 for inclusion in 8c00c428ffdb4840522b5e5a88c37ff1/family1 2023-07-11 17:54:48,501 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-07-11 17:54:48,501 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(777): Region bounds: first= last= 2023-07-11 17:54:48,502 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HRegion(2446): Flush status journal for 8c00c428ffdb4840522b5e5a88c37ff1: 2023-07-11 17:54:48,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/31507ac3c1434c87867ee52f542d0544 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__73q4h807j77ecpe5lktcmqh4p63lbtej8tctbsfvnkcn992k4uqhi93j04vuarg4/family1/31507ac3c1434c87867ee52f542d0544 2023-07-11 17:54:48,506 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__73q4h807j77ecpe5lktcmqh4p63lbtej8tctbsfvnkcn992k4uqhi93j04vuarg4/family1/31507ac3c1434c87867ee52f542d0544 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8c00c428ffdb4840522b5e5a88c37ff1/family1/a125d29cbd5f4460a14071294ecf7662_SeqId_53_ 2023-07-11 17:54:48,507 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(849): Loaded HFile hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__73q4h807j77ecpe5lktcmqh4p63lbtej8tctbsfvnkcn992k4uqhi93j04vuarg4/family1/31507ac3c1434c87867ee52f542d0544 into 8c00c428ffdb4840522b5e5a88c37ff1/family1 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8c00c428ffdb4840522b5e5a88c37ff1/family1/a125d29cbd5f4460a14071294ecf7662_SeqId_53_ - updating store file list. 2023-07-11 17:54:48,513 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(882): Loaded HFile hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8c00c428ffdb4840522b5e5a88c37ff1/family1/a125d29cbd5f4460a14071294ecf7662_SeqId_53_ into 8c00c428ffdb4840522b5e5a88c37ff1/family1 2023-07-11 17:54:48,513 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(855): Successfully loaded hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__73q4h807j77ecpe5lktcmqh4p63lbtej8tctbsfvnkcn992k4uqhi93j04vuarg4/family1/31507ac3c1434c87867ee52f542d0544 into 8c00c428ffdb4840522b5e5a88c37ff1/family1 (new location: hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8c00c428ffdb4840522b5e5a88c37ff1/family1/a125d29cbd5f4460a14071294ecf7662_SeqId_53_) 2023-07-11 17:54:48,513 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__73q4h807j77ecpe5lktcmqh4p63lbtej8tctbsfvnkcn992k4uqhi93j04vuarg4/family1/31507ac3c1434c87867ee52f542d0544 2023-07-11 17:54:48,515 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-07-11 17:54:48,515 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 17:54:48,517 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511207a08e92aa7804ec7bd16b6918a67758a to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511207a08e92aa7804ec7bd16b6918a67758a 2023-07-11 17:54:48,518 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151128e22138f4f2c04ca8b8e0410ac083185c to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151128e22138f4f2c04ca8b8e0410ac083185c 2023-07-11 17:54:48,518 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2 expired mob files are deleted 2023-07-11 17:54:48,518 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-07-11 17:54:48,518 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-07-11 17:54:48,518 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-07-11 17:54:48,518 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-07-11 17:54:48,518 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-07-11 17:54:48,519 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-07-11 17:54:48,520 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-07-11 17:54:48,521 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 922 msec 2023-07-11 17:54:48,568 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.HMaster$12(2454): Client=jenkins//172.31.2.10 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'} 2023-07-11 17:54:48,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:48,981 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000003 2023-07-11 17:54:48,982 DEBUG [PEWorker-5] util.FSTableDescriptors(519): Deleted hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-07-11 17:54:48,982 INFO [PEWorker-5] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000003 2023-07-11 17:54:48,984 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=66, ppid=65, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily}] 2023-07-11 17:54:48,987 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=8c00c428ffdb4840522b5e5a88c37ff1, REOPEN/MOVE}] 2023-07-11 17:54:48,987 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=8c00c428ffdb4840522b5e5a88c37ff1, REOPEN/MOVE 2023-07-11 17:54:48,988 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=8c00c428ffdb4840522b5e5a88c37ff1, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:48,988 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689098075959.8c00c428ffdb4840522b5e5a88c37ff1.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1689098088988"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689098088988"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689098088988"}]},"ts":"1689098088988"} 2023-07-11 17:54:48,990 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=68, ppid=67, state=RUNNABLE; CloseRegionProcedure 8c00c428ffdb4840522b5e5a88c37ff1, server=jenkins-hbase9.apache.org,45839,1689097999112}] 2023-07-11 17:54:49,142 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 8c00c428ffdb4840522b5e5a88c37ff1 2023-07-11 17:54:49,142 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 8c00c428ffdb4840522b5e5a88c37ff1, disabling compactions & flushes 2023-07-11 17:54:49,142 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689098075959.8c00c428ffdb4840522b5e5a88c37ff1. 2023-07-11 17:54:49,142 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689098075959.8c00c428ffdb4840522b5e5a88c37ff1. 2023-07-11 17:54:49,142 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689098075959.8c00c428ffdb4840522b5e5a88c37ff1. after waiting 0 ms 2023-07-11 17:54:49,142 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689098075959.8c00c428ffdb4840522b5e5a88c37ff1. 2023-07-11 17:54:49,152 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8c00c428ffdb4840522b5e5a88c37ff1/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-07-11 17:54:49,153 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689098075959.8c00c428ffdb4840522b5e5a88c37ff1. 2023-07-11 17:54:49,153 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 8c00c428ffdb4840522b5e5a88c37ff1: 2023-07-11 17:54:49,153 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(3510): Not adding moved region record: 8c00c428ffdb4840522b5e5a88c37ff1 to self. 2023-07-11 17:54:49,155 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=8c00c428ffdb4840522b5e5a88c37ff1, regionState=CLOSED 2023-07-11 17:54:49,155 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689098075959.8c00c428ffdb4840522b5e5a88c37ff1.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1689098089155"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689098089155"}]},"ts":"1689098089155"} 2023-07-11 17:54:49,156 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 8c00c428ffdb4840522b5e5a88c37ff1 2023-07-11 17:54:49,158 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=68, resume processing ppid=67 2023-07-11 17:54:49,159 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=67, state=SUCCESS; CloseRegionProcedure 8c00c428ffdb4840522b5e5a88c37ff1, server=jenkins-hbase9.apache.org,45839,1689097999112 in 167 msec 2023-07-11 17:54:49,159 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=8c00c428ffdb4840522b5e5a88c37ff1, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase9.apache.org,45839,1689097999112; forceNewPlan=false, retain=true 2023-07-11 17:54:49,309 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=8c00c428ffdb4840522b5e5a88c37ff1, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:49,314 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689098075959.8c00c428ffdb4840522b5e5a88c37ff1.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1689098089309"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689098089309"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689098089309"}]},"ts":"1689098089309"} 2023-07-11 17:54:49,317 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure 8c00c428ffdb4840522b5e5a88c37ff1, server=jenkins-hbase9.apache.org,45839,1689097999112}] 2023-07-11 17:54:49,472 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689098075959.8c00c428ffdb4840522b5e5a88c37ff1. 2023-07-11 17:54:49,472 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8c00c428ffdb4840522b5e5a88c37ff1, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689098075959.8c00c428ffdb4840522b5e5a88c37ff1.', STARTKEY => '', ENDKEY => ''} 2023-07-11 17:54:49,472 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 8c00c428ffdb4840522b5e5a88c37ff1 2023-07-11 17:54:49,472 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689098075959.8c00c428ffdb4840522b5e5a88c37ff1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 17:54:49,472 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 8c00c428ffdb4840522b5e5a88c37ff1 2023-07-11 17:54:49,472 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 8c00c428ffdb4840522b5e5a88c37ff1 2023-07-11 17:54:49,478 INFO [StoreOpener-8c00c428ffdb4840522b5e5a88c37ff1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 8c00c428ffdb4840522b5e5a88c37ff1 2023-07-11 17:54:49,479 DEBUG [StoreOpener-8c00c428ffdb4840522b5e5a88c37ff1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8c00c428ffdb4840522b5e5a88c37ff1/family1 2023-07-11 17:54:49,479 DEBUG [StoreOpener-8c00c428ffdb4840522b5e5a88c37ff1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8c00c428ffdb4840522b5e5a88c37ff1/family1 2023-07-11 17:54:49,481 INFO [StoreOpener-8c00c428ffdb4840522b5e5a88c37ff1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8c00c428ffdb4840522b5e5a88c37ff1 columnFamilyName family1 2023-07-11 17:54:49,489 DEBUG [StoreOpener-8c00c428ffdb4840522b5e5a88c37ff1-1] regionserver.HStore(539): loaded hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8c00c428ffdb4840522b5e5a88c37ff1/family1/99ba9dbfc9054c40a50cd3763bd5f3bb 2023-07-11 17:54:49,494 DEBUG [StoreOpener-8c00c428ffdb4840522b5e5a88c37ff1-1] regionserver.HStore(539): loaded hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8c00c428ffdb4840522b5e5a88c37ff1/family1/a125d29cbd5f4460a14071294ecf7662_SeqId_53_ 2023-07-11 17:54:49,494 INFO [StoreOpener-8c00c428ffdb4840522b5e5a88c37ff1-1] regionserver.HStore(310): Store=8c00c428ffdb4840522b5e5a88c37ff1/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 17:54:49,496 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8c00c428ffdb4840522b5e5a88c37ff1 2023-07-11 17:54:49,497 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8c00c428ffdb4840522b5e5a88c37ff1 2023-07-11 17:54:49,500 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 8c00c428ffdb4840522b5e5a88c37ff1 2023-07-11 17:54:49,504 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 8c00c428ffdb4840522b5e5a88c37ff1; next sequenceid=56; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66672659, jitterRate=-0.006499961018562317}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 17:54:49,504 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 8c00c428ffdb4840522b5e5a88c37ff1: 2023-07-11 17:54:49,505 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689098075959.8c00c428ffdb4840522b5e5a88c37ff1., pid=69, masterSystemTime=1689098089469 2023-07-11 17:54:49,506 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689098075959.8c00c428ffdb4840522b5e5a88c37ff1. 2023-07-11 17:54:49,507 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689098075959.8c00c428ffdb4840522b5e5a88c37ff1. 2023-07-11 17:54:49,507 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=8c00c428ffdb4840522b5e5a88c37ff1, regionState=OPEN, openSeqNum=56, regionLocation=jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:49,507 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689098075959.8c00c428ffdb4840522b5e5a88c37ff1.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1689098089507"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689098089507"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689098089507"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689098089507"}]},"ts":"1689098089507"} 2023-07-11 17:54:49,512 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=67 2023-07-11 17:54:49,513 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure 8c00c428ffdb4840522b5e5a88c37ff1, server=jenkins-hbase9.apache.org,45839,1689097999112 in 194 msec 2023-07-11 17:54:49,514 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=67, resume processing ppid=66 2023-07-11 17:54:49,515 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=8c00c428ffdb4840522b5e5a88c37ff1, REOPEN/MOVE in 526 msec 2023-07-11 17:54:49,517 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=66, resume processing ppid=65 2023-07-11 17:54:49,517 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=66, ppid=65, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 531 msec 2023-07-11 17:54:49,518 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 949 msec 2023-07-11 17:54:49,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1230): Checking to see if procedure is done pid=65 2023-07-11 17:54:49,520 INFO [Listener at localhost/43271] compactions.TestMobCompactor(278): alter status finished 2023-07-11 17:54:49,521 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=36885] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-07-11 17:54:49,523 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] procedure2.ProcedureExecutor(1029): Stored pid=70, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-07-11 17:54:49,523 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=70, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-07-11 17:54:49,524 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=70, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1689098689524 2023-07-11 17:54:49,524 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-07-11 17:54:49,525 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-07-11 17:54:49,525 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 4 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-07-11 17:54:49,525 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-07-11 17:54:49,526 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] zookeeper.ReadOnlyZKClient(139): Connect 0x52478fa0 to 127.0.0.1:50702 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 17:54:49,538 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@69db6e70, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 17:54:49,539 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151128 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-07-11 17:54:49,539 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151128 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-07-11 17:54:49,539 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151205 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-07-11 17:54:49,539 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151205 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-07-11 17:54:49,539 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160103 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-07-11 17:54:49,539 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160103 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-07-11 17:54:49,539 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-07-11 17:54:49,539 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-07-11 17:54:49,539 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-07-11 17:54:49,539 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-07-11 17:54:49,540 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=70, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-07-11 17:54:49,541 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=70, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 18 msec 2023-07-11 17:54:49,596 INFO [Listener at localhost/43271] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily Thread=249 (was 240) - Thread LEAK? -, OpenFileDescriptor=644 (was 606) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=197 (was 178) - SystemLoadAverage LEAK? -, ProcessCount=170 (was 170), AvailableMemoryMB=8368 (was 8494) 2023-07-11 17:54:49,613 INFO [Listener at localhost/43271] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testGetAfterCompaction Thread=249, OpenFileDescriptor=644, MaxFileDescriptor=60000, SystemLoadAverage=197, ProcessCount=170, AvailableMemoryMB=8366 2023-07-11 17:54:49,617 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testGetAfterCompaction', {TABLE_ATTRIBUTES => {coprocessor$1 => '|org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro|1073741823|'}}, {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-11 17:54:49,619 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testGetAfterCompaction 2023-07-11 17:54:49,621 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_PRE_OPERATION 2023-07-11 17:54:49,621 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testGetAfterCompaction" procId is: 71 2023-07-11 17:54:49,623 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-11 17:54:49,634 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-11 17:54:49,643 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/.tmp/data/default/testGetAfterCompaction/3f2d34aabb76b9d0964d22dd41a84201 2023-07-11 17:54:49,647 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/.tmp/data/default/testGetAfterCompaction/3f2d34aabb76b9d0964d22dd41a84201 empty. 2023-07-11 17:54:49,648 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/.tmp/data/default/testGetAfterCompaction/3f2d34aabb76b9d0964d22dd41a84201 2023-07-11 17:54:49,648 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testGetAfterCompaction regions 2023-07-11 17:54:49,679 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/.tmp/data/default/testGetAfterCompaction/.tabledesc/.tableinfo.0000000001 2023-07-11 17:54:49,682 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(7675): creating {ENCODED => 3f2d34aabb76b9d0964d22dd41a84201, NAME => 'testGetAfterCompaction,,1689098089617.3f2d34aabb76b9d0964d22dd41a84201.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testGetAfterCompaction', {TABLE_ATTRIBUTES => {coprocessor$1 => '|org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro|1073741823|'}}, {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/.tmp 2023-07-11 17:54:49,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-11 17:54:49,937 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-11 17:54:50,105 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(866): Instantiated testGetAfterCompaction,,1689098089617.3f2d34aabb76b9d0964d22dd41a84201.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 17:54:50,105 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1604): Closing 3f2d34aabb76b9d0964d22dd41a84201, disabling compactions & flushes 2023-07-11 17:54:50,105 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1626): Closing region testGetAfterCompaction,,1689098089617.3f2d34aabb76b9d0964d22dd41a84201. 2023-07-11 17:54:50,105 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testGetAfterCompaction,,1689098089617.3f2d34aabb76b9d0964d22dd41a84201. 2023-07-11 17:54:50,105 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1714): Acquired close lock on testGetAfterCompaction,,1689098089617.3f2d34aabb76b9d0964d22dd41a84201. after waiting 0 ms 2023-07-11 17:54:50,105 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1724): Updates disabled for region testGetAfterCompaction,,1689098089617.3f2d34aabb76b9d0964d22dd41a84201. 2023-07-11 17:54:50,105 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1838): Closed testGetAfterCompaction,,1689098089617.3f2d34aabb76b9d0964d22dd41a84201. 2023-07-11 17:54:50,105 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1558): Region close journal for 3f2d34aabb76b9d0964d22dd41a84201: 2023-07-11 17:54:50,108 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_ADD_TO_META 2023-07-11 17:54:50,109 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testGetAfterCompaction,,1689098089617.3f2d34aabb76b9d0964d22dd41a84201.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1689098090108"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689098090108"}]},"ts":"1689098090108"} 2023-07-11 17:54:50,110 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-11 17:54:50,111 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-11 17:54:50,111 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689098090111"}]},"ts":"1689098090111"} 2023-07-11 17:54:50,112 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=ENABLING in hbase:meta 2023-07-11 17:54:50,116 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testGetAfterCompaction, region=3f2d34aabb76b9d0964d22dd41a84201, ASSIGN}] 2023-07-11 17:54:50,117 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testGetAfterCompaction, region=3f2d34aabb76b9d0964d22dd41a84201, ASSIGN 2023-07-11 17:54:50,118 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testGetAfterCompaction, region=3f2d34aabb76b9d0964d22dd41a84201, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,45839,1689097999112; forceNewPlan=false, retain=false 2023-07-11 17:54:50,238 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-11 17:54:50,269 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=3f2d34aabb76b9d0964d22dd41a84201, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:50,269 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testGetAfterCompaction,,1689098089617.3f2d34aabb76b9d0964d22dd41a84201.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1689098090269"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689098090269"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689098090269"}]},"ts":"1689098090269"} 2023-07-11 17:54:50,271 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=73, ppid=72, state=RUNNABLE; OpenRegionProcedure 3f2d34aabb76b9d0964d22dd41a84201, server=jenkins-hbase9.apache.org,45839,1689097999112}] 2023-07-11 17:54:50,424 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testGetAfterCompaction,,1689098089617.3f2d34aabb76b9d0964d22dd41a84201. 2023-07-11 17:54:50,424 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 3f2d34aabb76b9d0964d22dd41a84201, NAME => 'testGetAfterCompaction,,1689098089617.3f2d34aabb76b9d0964d22dd41a84201.', STARTKEY => '', ENDKEY => ''} 2023-07-11 17:54:50,425 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro with path null and priority 1073741823 2023-07-11 17:54:50,426 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro from HTD of testGetAfterCompaction successfully. 2023-07-11 17:54:50,426 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testGetAfterCompaction 3f2d34aabb76b9d0964d22dd41a84201 2023-07-11 17:54:50,426 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testGetAfterCompaction,,1689098089617.3f2d34aabb76b9d0964d22dd41a84201.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 17:54:50,426 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 3f2d34aabb76b9d0964d22dd41a84201 2023-07-11 17:54:50,427 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 3f2d34aabb76b9d0964d22dd41a84201 2023-07-11 17:54:50,428 INFO [StoreOpener-3f2d34aabb76b9d0964d22dd41a84201-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 3f2d34aabb76b9d0964d22dd41a84201 2023-07-11 17:54:50,429 DEBUG [StoreOpener-3f2d34aabb76b9d0964d22dd41a84201-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testGetAfterCompaction/3f2d34aabb76b9d0964d22dd41a84201/f1 2023-07-11 17:54:50,429 DEBUG [StoreOpener-3f2d34aabb76b9d0964d22dd41a84201-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testGetAfterCompaction/3f2d34aabb76b9d0964d22dd41a84201/f1 2023-07-11 17:54:50,429 INFO [StoreOpener-3f2d34aabb76b9d0964d22dd41a84201-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3f2d34aabb76b9d0964d22dd41a84201 columnFamilyName f1 2023-07-11 17:54:50,431 INFO [StoreOpener-3f2d34aabb76b9d0964d22dd41a84201-1] regionserver.HStore(310): Store=3f2d34aabb76b9d0964d22dd41a84201/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 17:54:50,432 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testGetAfterCompaction/3f2d34aabb76b9d0964d22dd41a84201 2023-07-11 17:54:50,432 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testGetAfterCompaction/3f2d34aabb76b9d0964d22dd41a84201 2023-07-11 17:54:50,435 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 3f2d34aabb76b9d0964d22dd41a84201 2023-07-11 17:54:50,436 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testGetAfterCompaction/3f2d34aabb76b9d0964d22dd41a84201/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 17:54:50,437 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 3f2d34aabb76b9d0964d22dd41a84201; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61680391, jitterRate=-0.08089055120944977}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 17:54:50,437 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 3f2d34aabb76b9d0964d22dd41a84201: 2023-07-11 17:54:50,438 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testGetAfterCompaction,,1689098089617.3f2d34aabb76b9d0964d22dd41a84201., pid=73, masterSystemTime=1689098090422 2023-07-11 17:54:50,439 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testGetAfterCompaction,,1689098089617.3f2d34aabb76b9d0964d22dd41a84201. 2023-07-11 17:54:50,439 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testGetAfterCompaction,,1689098089617.3f2d34aabb76b9d0964d22dd41a84201. 2023-07-11 17:54:50,440 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=3f2d34aabb76b9d0964d22dd41a84201, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:50,440 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testGetAfterCompaction,,1689098089617.3f2d34aabb76b9d0964d22dd41a84201.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1689098090439"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689098090439"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689098090439"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689098090439"}]},"ts":"1689098090439"} 2023-07-11 17:54:50,443 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=73, resume processing ppid=72 2023-07-11 17:54:50,443 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=72, state=SUCCESS; OpenRegionProcedure 3f2d34aabb76b9d0964d22dd41a84201, server=jenkins-hbase9.apache.org,45839,1689097999112 in 170 msec 2023-07-11 17:54:50,444 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=72, resume processing ppid=71 2023-07-11 17:54:50,445 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testGetAfterCompaction, region=3f2d34aabb76b9d0964d22dd41a84201, ASSIGN in 327 msec 2023-07-11 17:54:50,445 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-11 17:54:50,445 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689098090445"}]},"ts":"1689098090445"} 2023-07-11 17:54:50,446 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=ENABLED in hbase:meta 2023-07-11 17:54:50,448 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_POST_OPERATION 2023-07-11 17:54:50,449 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; CreateTableProcedure table=testGetAfterCompaction in 830 msec 2023-07-11 17:54:50,739 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-11 17:54:50,739 INFO [Listener at localhost/43271] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testGetAfterCompaction, procId: 71 completed 2023-07-11 17:54:50,740 DEBUG [Listener at localhost/43271] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testGetAfterCompaction get assigned. Timeout = 60000ms 2023-07-11 17:54:50,742 INFO [Listener at localhost/43271] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-11 17:54:50,745 INFO [Listener at localhost/43271] hbase.HBaseTestingUtility(3484): All regions for table testGetAfterCompaction assigned to meta. Checking AM states. 2023-07-11 17:54:50,746 INFO [Listener at localhost/43271] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-11 17:54:50,746 INFO [Listener at localhost/43271] hbase.HBaseTestingUtility(3504): All regions for table testGetAfterCompaction assigned. 2023-07-11 17:54:50,751 INFO [Listener at localhost/43271] regionserver.HRegion(2745): Flushing 3f2d34aabb76b9d0964d22dd41a84201 1/1 column families, dataSize=37 B heapSize=368 B 2023-07-11 17:54:51,168 INFO [Listener at localhost/43271] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023071119cfb6887cec4390b978c0c5a95123e6 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e2023071119cfb6887cec4390b978c0c5a95123e6 2023-07-11 17:54:51,574 INFO [Listener at localhost/43271] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=37, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testGetAfterCompaction/3f2d34aabb76b9d0964d22dd41a84201/.tmp/f1/68f95eec3d0449dc87810762723ca71f 2023-07-11 17:54:51,579 DEBUG [Listener at localhost/43271] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testGetAfterCompaction/3f2d34aabb76b9d0964d22dd41a84201/.tmp/f1/68f95eec3d0449dc87810762723ca71f as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testGetAfterCompaction/3f2d34aabb76b9d0964d22dd41a84201/f1/68f95eec3d0449dc87810762723ca71f 2023-07-11 17:54:51,583 INFO [Listener at localhost/43271] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testGetAfterCompaction/3f2d34aabb76b9d0964d22dd41a84201/f1/68f95eec3d0449dc87810762723ca71f, entries=1, sequenceid=5, filesize=4.9 K 2023-07-11 17:54:51,584 INFO [Listener at localhost/43271] regionserver.HRegion(2948): Finished flush of dataSize ~37 B/37, heapSize ~352 B/352, currentSize=0 B/0 for 3f2d34aabb76b9d0964d22dd41a84201 in 833ms, sequenceid=5, compaction requested=false 2023-07-11 17:54:51,584 DEBUG [Listener at localhost/43271] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testGetAfterCompaction' 2023-07-11 17:54:51,584 DEBUG [Listener at localhost/43271] regionserver.HRegion(2446): Flush status journal for 3f2d34aabb76b9d0964d22dd41a84201: 2023-07-11 17:54:51,586 INFO [Listener at localhost/43271] regionserver.HRegion(2745): Flushing 3f2d34aabb76b9d0964d22dd41a84201 1/1 column families, dataSize=37 B heapSize=368 B 2023-07-11 17:54:51,597 INFO [Listener at localhost/43271] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230711708f9a42e7844a169e9512a6a0e7e6cd to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230711708f9a42e7844a169e9512a6a0e7e6cd 2023-07-11 17:54:52,002 INFO [Listener at localhost/43271] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=37, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testGetAfterCompaction/3f2d34aabb76b9d0964d22dd41a84201/.tmp/f1/2639ffb08b8b4b2fb5096daa6f126cac 2023-07-11 17:54:52,006 DEBUG [Listener at localhost/43271] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testGetAfterCompaction/3f2d34aabb76b9d0964d22dd41a84201/.tmp/f1/2639ffb08b8b4b2fb5096daa6f126cac as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testGetAfterCompaction/3f2d34aabb76b9d0964d22dd41a84201/f1/2639ffb08b8b4b2fb5096daa6f126cac 2023-07-11 17:54:52,010 INFO [Listener at localhost/43271] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testGetAfterCompaction/3f2d34aabb76b9d0964d22dd41a84201/f1/2639ffb08b8b4b2fb5096daa6f126cac, entries=1, sequenceid=9, filesize=4.9 K 2023-07-11 17:54:52,010 INFO [Listener at localhost/43271] regionserver.HRegion(2948): Finished flush of dataSize ~37 B/37, heapSize ~352 B/352, currentSize=0 B/0 for 3f2d34aabb76b9d0964d22dd41a84201 in 424ms, sequenceid=9, compaction requested=false 2023-07-11 17:54:52,011 DEBUG [Listener at localhost/43271] regionserver.HRegion(2446): Flush status journal for 3f2d34aabb76b9d0964d22dd41a84201: 2023-07-11 17:54:52,012 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=36885] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testGetAfterCompaction 2023-07-11 17:54:52,013 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] procedure2.ProcedureExecutor(1029): Stored pid=74, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-07-11 17:54:52,014 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=74, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-07-11 17:54:52,014 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] mob.MobUtils(833): start MOB compaction of files for table='testGetAfterCompaction', column='f1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-07-11 17:54:52,014 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=74, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1689098692014 2023-07-11 17:54:52,015 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-07-11 17:54:52,015 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 2 selected files, and 0 irrelevant files table 'testGetAfterCompaction' and column 'f1' 2023-07-11 17:54:52,015 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testGetAfterCompaction' column='f1' 2023-07-11 17:54:52,015 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] zookeeper.ReadOnlyZKClient(139): Connect 0x673da8c6 to 127.0.0.1:50702 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 17:54:52,019 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5527f2bf, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 17:54:52,019 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230711 for table='testGetAfterCompaction' and column='f1' 2023-07-11 17:54:52,063 INFO [Listener at localhost/43271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testGetAfterCompaction/3f2d34aabb76b9d0964d22dd41a84201/f1/2639ffb08b8b4b2fb5096daa6f126cac; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689098092002; access_time=1689098091588; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-11 17:54:52,063 INFO [Listener at localhost/43271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testGetAfterCompaction/3f2d34aabb76b9d0964d22dd41a84201/f1/68f95eec3d0449dc87810762723ca71f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689098091573; access_time=1689098090753; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-11 17:54:52,114 INFO [Listener at localhost/43271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testGetAfterCompaction/3f2d34aabb76b9d0964d22dd41a84201/f1/2639ffb08b8b4b2fb5096daa6f126cac; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689098092002; access_time=1689098091588; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-11 17:54:52,114 INFO [Listener at localhost/43271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testGetAfterCompaction/3f2d34aabb76b9d0964d22dd41a84201/f1/68f95eec3d0449dc87810762723ca71f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689098091573; access_time=1689098090753; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-11 17:54:52,165 INFO [Listener at localhost/43271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testGetAfterCompaction/3f2d34aabb76b9d0964d22dd41a84201/f1/2639ffb08b8b4b2fb5096daa6f126cac; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689098092002; access_time=1689098091588; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-11 17:54:52,165 INFO [Listener at localhost/43271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testGetAfterCompaction/3f2d34aabb76b9d0964d22dd41a84201/f1/68f95eec3d0449dc87810762723ca71f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689098091573; access_time=1689098090753; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-11 17:54:52,216 INFO [Listener at localhost/43271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testGetAfterCompaction/3f2d34aabb76b9d0964d22dd41a84201/f1/2639ffb08b8b4b2fb5096daa6f126cac; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689098092002; access_time=1689098091588; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-11 17:54:52,216 INFO [Listener at localhost/43271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testGetAfterCompaction/3f2d34aabb76b9d0964d22dd41a84201/f1/68f95eec3d0449dc87810762723ca71f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689098091573; access_time=1689098090753; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-11 17:54:52,267 INFO [Listener at localhost/43271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testGetAfterCompaction/3f2d34aabb76b9d0964d22dd41a84201/f1/2639ffb08b8b4b2fb5096daa6f126cac; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689098092002; access_time=1689098091588; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-11 17:54:52,267 INFO [Listener at localhost/43271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testGetAfterCompaction/3f2d34aabb76b9d0964d22dd41a84201/f1/68f95eec3d0449dc87810762723ca71f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689098091573; access_time=1689098090753; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-11 17:54:52,318 INFO [Listener at localhost/43271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testGetAfterCompaction/3f2d34aabb76b9d0964d22dd41a84201/f1/2639ffb08b8b4b2fb5096daa6f126cac; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689098092002; access_time=1689098091588; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-11 17:54:52,318 INFO [Listener at localhost/43271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testGetAfterCompaction/3f2d34aabb76b9d0964d22dd41a84201/f1/68f95eec3d0449dc87810762723ca71f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689098091573; access_time=1689098090753; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-11 17:54:52,368 INFO [Listener at localhost/43271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testGetAfterCompaction/3f2d34aabb76b9d0964d22dd41a84201/f1/2639ffb08b8b4b2fb5096daa6f126cac; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689098092002; access_time=1689098091588; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-11 17:54:52,369 INFO [Listener at localhost/43271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testGetAfterCompaction/3f2d34aabb76b9d0964d22dd41a84201/f1/68f95eec3d0449dc87810762723ca71f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689098091573; access_time=1689098090753; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-11 17:54:52,419 INFO [Listener at localhost/43271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testGetAfterCompaction/3f2d34aabb76b9d0964d22dd41a84201/f1/2639ffb08b8b4b2fb5096daa6f126cac; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689098092002; access_time=1689098091588; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-11 17:54:52,420 INFO [Listener at localhost/43271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testGetAfterCompaction/3f2d34aabb76b9d0964d22dd41a84201/f1/68f95eec3d0449dc87810762723ca71f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689098091573; access_time=1689098090753; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-11 17:54:52,470 INFO [Listener at localhost/43271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testGetAfterCompaction/3f2d34aabb76b9d0964d22dd41a84201/f1/2639ffb08b8b4b2fb5096daa6f126cac; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689098092002; access_time=1689098091588; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-11 17:54:52,470 INFO [Listener at localhost/43271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testGetAfterCompaction/3f2d34aabb76b9d0964d22dd41a84201/f1/68f95eec3d0449dc87810762723ca71f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689098091573; access_time=1689098090753; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-11 17:54:52,521 INFO [Listener at localhost/43271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testGetAfterCompaction/3f2d34aabb76b9d0964d22dd41a84201/f1/2639ffb08b8b4b2fb5096daa6f126cac; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689098092002; access_time=1689098091588; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-11 17:54:52,521 INFO [Listener at localhost/43271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testGetAfterCompaction/3f2d34aabb76b9d0964d22dd41a84201/f1/68f95eec3d0449dc87810762723ca71f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689098091573; access_time=1689098090753; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-11 17:54:52,572 INFO [Listener at localhost/43271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testGetAfterCompaction/3f2d34aabb76b9d0964d22dd41a84201/f1/2639ffb08b8b4b2fb5096daa6f126cac; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689098092002; access_time=1689098091588; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-11 17:54:52,572 INFO [Listener at localhost/43271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testGetAfterCompaction/3f2d34aabb76b9d0964d22dd41a84201/f1/68f95eec3d0449dc87810762723ca71f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689098091573; access_time=1689098090753; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-11 17:54:52,623 INFO [Listener at localhost/43271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testGetAfterCompaction/3f2d34aabb76b9d0964d22dd41a84201/f1/2639ffb08b8b4b2fb5096daa6f126cac; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689098092002; access_time=1689098091588; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-11 17:54:52,623 INFO [Listener at localhost/43271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testGetAfterCompaction/3f2d34aabb76b9d0964d22dd41a84201/f1/68f95eec3d0449dc87810762723ca71f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689098091573; access_time=1689098090753; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-11 17:54:52,674 INFO [Listener at localhost/43271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testGetAfterCompaction/3f2d34aabb76b9d0964d22dd41a84201/f1/2639ffb08b8b4b2fb5096daa6f126cac; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689098092002; access_time=1689098091588; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-11 17:54:52,674 INFO [Listener at localhost/43271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testGetAfterCompaction/3f2d34aabb76b9d0964d22dd41a84201/f1/68f95eec3d0449dc87810762723ca71f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689098091573; access_time=1689098090753; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-11 17:54:52,725 INFO [Listener at localhost/43271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testGetAfterCompaction/3f2d34aabb76b9d0964d22dd41a84201/f1/2639ffb08b8b4b2fb5096daa6f126cac; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689098092002; access_time=1689098091588; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-11 17:54:52,725 INFO [Listener at localhost/43271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testGetAfterCompaction/3f2d34aabb76b9d0964d22dd41a84201/f1/68f95eec3d0449dc87810762723ca71f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689098091573; access_time=1689098090753; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-11 17:54:52,775 INFO [Listener at localhost/43271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testGetAfterCompaction/3f2d34aabb76b9d0964d22dd41a84201/f1/2639ffb08b8b4b2fb5096daa6f126cac; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689098092002; access_time=1689098091588; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-11 17:54:52,775 INFO [Listener at localhost/43271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testGetAfterCompaction/3f2d34aabb76b9d0964d22dd41a84201/f1/68f95eec3d0449dc87810762723ca71f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689098091573; access_time=1689098090753; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-11 17:54:52,800 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-07-11 17:54:52,826 INFO [Listener at localhost/43271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testGetAfterCompaction/3f2d34aabb76b9d0964d22dd41a84201/f1/2639ffb08b8b4b2fb5096daa6f126cac; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689098092002; access_time=1689098091588; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-11 17:54:52,826 INFO [Listener at localhost/43271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testGetAfterCompaction/3f2d34aabb76b9d0964d22dd41a84201/f1/68f95eec3d0449dc87810762723ca71f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689098091573; access_time=1689098090753; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-11 17:54:52,846 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230711f7c58fac5f7d4c9c80090f427a35d2b7 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230711f7c58fac5f7d4c9c80090f427a35d2b7 2023-07-11 17:54:52,847 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230711 table='testGetAfterCompaction' column='f1' 2023-07-11 17:54:52,860 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 17:54:52,861 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:52512, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 17:54:52,867 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-11 17:54:52,869 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:52756, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-11 17:54:52,877 INFO [Listener at localhost/43271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testGetAfterCompaction/3f2d34aabb76b9d0964d22dd41a84201/f1/2639ffb08b8b4b2fb5096daa6f126cac; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689098092002; access_time=1689098091588; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-11 17:54:52,877 INFO [Listener at localhost/43271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testGetAfterCompaction/3f2d34aabb76b9d0964d22dd41a84201/f1/68f95eec3d0449dc87810762723ca71f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689098091573; access_time=1689098090753; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-11 17:54:52,880 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230711/f1/93e6adade67841b1897cf6b4c21e5df4 first=Optional[r1] last=Optional[r2] 2023-07-11 17:54:52,881 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testGetAfterCompaction,,1689098089617.3f2d34aabb76b9d0964d22dd41a84201., hostname=jenkins-hbase9.apache.org,45839,1689097999112, seqNum=2 for row with hfile group [{f1,hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230711/f1/93e6adade67841b1897cf6b4c21e5df4}] 2023-07-11 17:54:52,885 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(763): Validating hfile at hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230711/f1/93e6adade67841b1897cf6b4c21e5df4 for inclusion in 3f2d34aabb76b9d0964d22dd41a84201/f1 2023-07-11 17:54:52,887 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(775): HFile bounds: first=r1 last=r2 2023-07-11 17:54:52,887 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(777): Region bounds: first= last= 2023-07-11 17:54:52,887 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HRegion(2446): Flush status journal for 3f2d34aabb76b9d0964d22dd41a84201: 2023-07-11 17:54:52,888 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230711/f1/93e6adade67841b1897cf6b4c21e5df4 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testGetAfterCompaction__7enefhvjktgsvccdome0ovodjvbsh7rpar3e2o8smcrfcr5v38t3d9p6eg9t2je7/f1/93e6adade67841b1897cf6b4c21e5df4 2023-07-11 17:54:52,889 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testGetAfterCompaction__7enefhvjktgsvccdome0ovodjvbsh7rpar3e2o8smcrfcr5v38t3d9p6eg9t2je7/f1/93e6adade67841b1897cf6b4c21e5df4 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testGetAfterCompaction/3f2d34aabb76b9d0964d22dd41a84201/f1/0700a6affb144638bd78a7b9b7b7c37b_SeqId_12_ 2023-07-11 17:54:52,890 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(849): Loaded HFile hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testGetAfterCompaction__7enefhvjktgsvccdome0ovodjvbsh7rpar3e2o8smcrfcr5v38t3d9p6eg9t2je7/f1/93e6adade67841b1897cf6b4c21e5df4 into 3f2d34aabb76b9d0964d22dd41a84201/f1 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testGetAfterCompaction/3f2d34aabb76b9d0964d22dd41a84201/f1/0700a6affb144638bd78a7b9b7b7c37b_SeqId_12_ - updating store file list. 2023-07-11 17:54:52,893 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(882): Loaded HFile hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testGetAfterCompaction/3f2d34aabb76b9d0964d22dd41a84201/f1/0700a6affb144638bd78a7b9b7b7c37b_SeqId_12_ into 3f2d34aabb76b9d0964d22dd41a84201/f1 2023-07-11 17:54:52,893 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(855): Successfully loaded hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testGetAfterCompaction__7enefhvjktgsvccdome0ovodjvbsh7rpar3e2o8smcrfcr5v38t3d9p6eg9t2je7/f1/93e6adade67841b1897cf6b4c21e5df4 into 3f2d34aabb76b9d0964d22dd41a84201/f1 (new location: hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testGetAfterCompaction/3f2d34aabb76b9d0964d22dd41a84201/f1/0700a6affb144638bd78a7b9b7b7c37b_SeqId_12_) 2023-07-11 17:54:52,894 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testGetAfterCompaction__7enefhvjktgsvccdome0ovodjvbsh7rpar3e2o8smcrfcr5v38t3d9p6eg9t2je7/f1/93e6adade67841b1897cf6b4c21e5df4 2023-07-11 17:54:52,894 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(1912): 3f2d34aabb76b9d0964d22dd41a84201/f1 is initiating minor compaction 2023-07-11 17:54:52,894 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@2b2e10d3; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-11 17:54:52,894 INFO [RS:0;jenkins-hbase9:45839-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 3f2d34aabb76b9d0964d22dd41a84201/f1 in testGetAfterCompaction,,1689098089617.3f2d34aabb76b9d0964d22dd41a84201. 2023-07-11 17:54:52,894 INFO [RS:0;jenkins-hbase9:45839-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testGetAfterCompaction/3f2d34aabb76b9d0964d22dd41a84201/f1/2639ffb08b8b4b2fb5096daa6f126cac, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testGetAfterCompaction/3f2d34aabb76b9d0964d22dd41a84201/f1/0700a6affb144638bd78a7b9b7b7c37b_SeqId_12_] into tmpdir=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testGetAfterCompaction/3f2d34aabb76b9d0964d22dd41a84201/.tmp, totalSize=10.0 K 2023-07-11 17:54:52,894 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] compactions.Compactor(207): Compacting 2639ffb08b8b4b2fb5096daa6f126cac, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=9 2023-07-11 17:54:52,894 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] compactions.Compactor(207): Compacting 0700a6affb144638bd78a7b9b7b7c37b_SeqId_12_, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13 2023-07-11 17:54:52,896 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230711 table='testGetAfterCompaction' column='f1' 2023-07-11 17:54:52,897 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 17:54:52,898 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e2023071119cfb6887cec4390b978c0c5a95123e6 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e2023071119cfb6887cec4390b978c0c5a95123e6 2023-07-11 17:54:52,900 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230711708f9a42e7844a169e9512a6a0e7e6cd to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230711708f9a42e7844a169e9512a6a0e7e6cd 2023-07-11 17:54:52,900 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testGetAfterCompaction 2 expired mob files are deleted 2023-07-11 17:54:52,900 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230711' 2023-07-11 17:54:52,900 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230711 for table='testGetAfterCompaction' and column='f1' 2023-07-11 17:54:52,900 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] compactions.PartitionedMobCompactor(354): After compaction, there are 1 mob files. table='testGetAfterCompaction' column='f1' 2023-07-11 17:54:52,900 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] mob.MobUtils(840): end MOB compaction of files for table='testGetAfterCompaction', column='f1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-07-11 17:54:52,901 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=74, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-07-11 17:54:52,903 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=74, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE in 889 msec 2023-07-11 17:54:52,903 INFO [RS:0;jenkins-hbase9:45839-shortCompactions-0] throttle.PressureAwareThroughputController(145): 3f2d34aabb76b9d0964d22dd41a84201#f1#compaction#76 average throughput is 0.08 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-11 17:54:52,928 INFO [Listener at localhost/43271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testGetAfterCompaction/3f2d34aabb76b9d0964d22dd41a84201/f1/0700a6affb144638bd78a7b9b7b7c37b_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1689098092842; access_time=1689098092031; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-07-11 17:54:52,928 INFO [Listener at localhost/43271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testGetAfterCompaction/3f2d34aabb76b9d0964d22dd41a84201/f1/2639ffb08b8b4b2fb5096daa6f126cac; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689098092002; access_time=1689098091588; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-11 17:54:52,928 INFO [Listener at localhost/43271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testGetAfterCompaction/3f2d34aabb76b9d0964d22dd41a84201/f1/68f95eec3d0449dc87810762723ca71f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689098091573; access_time=1689098090753; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-11 17:54:52,931 DEBUG [Listener at localhost/43271] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-11 17:54:52,934 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:52526, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-11 17:54:52,934 INFO [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=45839] regionserver.RSRpcServices(1662): Compacting testGetAfterCompaction,,1689098089617.3f2d34aabb76b9d0964d22dd41a84201. 2023-07-11 17:54:52,935 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=45839] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 2 compacting, 0 eligible, 16 blocking 2023-07-11 17:54:52,935 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=45839] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-07-11 17:54:52,935 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=45839] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-07-11 17:54:52,935 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=45839] regionserver.CompactSplit(415): Not compacting testGetAfterCompaction,,1689098089617.3f2d34aabb76b9d0964d22dd41a84201. because compaction request was cancelled 2023-07-11 17:54:52,986 INFO [Listener at localhost/43271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testGetAfterCompaction/3f2d34aabb76b9d0964d22dd41a84201/f1/0700a6affb144638bd78a7b9b7b7c37b_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1689098092842; access_time=1689098092031; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-07-11 17:54:52,987 INFO [Listener at localhost/43271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testGetAfterCompaction/3f2d34aabb76b9d0964d22dd41a84201/f1/2639ffb08b8b4b2fb5096daa6f126cac; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689098092002; access_time=1689098091588; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-11 17:54:52,987 INFO [Listener at localhost/43271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testGetAfterCompaction/3f2d34aabb76b9d0964d22dd41a84201/f1/68f95eec3d0449dc87810762723ca71f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689098091573; access_time=1689098090753; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-11 17:54:53,037 INFO [Listener at localhost/43271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testGetAfterCompaction/3f2d34aabb76b9d0964d22dd41a84201/f1/0700a6affb144638bd78a7b9b7b7c37b_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1689098092842; access_time=1689098092031; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-07-11 17:54:53,037 INFO [Listener at localhost/43271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testGetAfterCompaction/3f2d34aabb76b9d0964d22dd41a84201/f1/2639ffb08b8b4b2fb5096daa6f126cac; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689098092002; access_time=1689098091588; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-11 17:54:53,037 INFO [Listener at localhost/43271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testGetAfterCompaction/3f2d34aabb76b9d0964d22dd41a84201/f1/68f95eec3d0449dc87810762723ca71f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689098091573; access_time=1689098090753; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-11 17:54:53,088 INFO [Listener at localhost/43271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testGetAfterCompaction/3f2d34aabb76b9d0964d22dd41a84201/f1/0700a6affb144638bd78a7b9b7b7c37b_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1689098092842; access_time=1689098092031; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-07-11 17:54:53,088 INFO [Listener at localhost/43271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testGetAfterCompaction/3f2d34aabb76b9d0964d22dd41a84201/f1/2639ffb08b8b4b2fb5096daa6f126cac; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689098092002; access_time=1689098091588; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-11 17:54:53,088 INFO [Listener at localhost/43271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testGetAfterCompaction/3f2d34aabb76b9d0964d22dd41a84201/f1/68f95eec3d0449dc87810762723ca71f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689098091573; access_time=1689098090753; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-11 17:54:53,139 INFO [Listener at localhost/43271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testGetAfterCompaction/3f2d34aabb76b9d0964d22dd41a84201/f1/0700a6affb144638bd78a7b9b7b7c37b_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1689098092842; access_time=1689098092031; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-07-11 17:54:53,139 INFO [Listener at localhost/43271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testGetAfterCompaction/3f2d34aabb76b9d0964d22dd41a84201/f1/2639ffb08b8b4b2fb5096daa6f126cac; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689098092002; access_time=1689098091588; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-11 17:54:53,139 INFO [Listener at localhost/43271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testGetAfterCompaction/3f2d34aabb76b9d0964d22dd41a84201/f1/68f95eec3d0449dc87810762723ca71f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689098091573; access_time=1689098090753; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-11 17:54:53,190 INFO [Listener at localhost/43271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testGetAfterCompaction/3f2d34aabb76b9d0964d22dd41a84201/f1/0700a6affb144638bd78a7b9b7b7c37b_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1689098092842; access_time=1689098092031; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-07-11 17:54:53,190 INFO [Listener at localhost/43271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testGetAfterCompaction/3f2d34aabb76b9d0964d22dd41a84201/f1/2639ffb08b8b4b2fb5096daa6f126cac; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689098092002; access_time=1689098091588; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-11 17:54:53,190 INFO [Listener at localhost/43271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testGetAfterCompaction/3f2d34aabb76b9d0964d22dd41a84201/f1/68f95eec3d0449dc87810762723ca71f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689098091573; access_time=1689098090753; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-11 17:54:53,241 INFO [Listener at localhost/43271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testGetAfterCompaction/3f2d34aabb76b9d0964d22dd41a84201/f1/0700a6affb144638bd78a7b9b7b7c37b_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1689098092842; access_time=1689098092031; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-07-11 17:54:53,241 INFO [Listener at localhost/43271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testGetAfterCompaction/3f2d34aabb76b9d0964d22dd41a84201/f1/2639ffb08b8b4b2fb5096daa6f126cac; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689098092002; access_time=1689098091588; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-11 17:54:53,241 INFO [Listener at localhost/43271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testGetAfterCompaction/3f2d34aabb76b9d0964d22dd41a84201/f1/68f95eec3d0449dc87810762723ca71f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689098091573; access_time=1689098090753; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-11 17:54:53,291 INFO [Listener at localhost/43271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testGetAfterCompaction/3f2d34aabb76b9d0964d22dd41a84201/f1/0700a6affb144638bd78a7b9b7b7c37b_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1689098092842; access_time=1689098092031; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-07-11 17:54:53,292 INFO [Listener at localhost/43271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testGetAfterCompaction/3f2d34aabb76b9d0964d22dd41a84201/f1/2639ffb08b8b4b2fb5096daa6f126cac; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689098092002; access_time=1689098091588; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-11 17:54:53,292 INFO [Listener at localhost/43271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testGetAfterCompaction/3f2d34aabb76b9d0964d22dd41a84201/f1/68f95eec3d0449dc87810762723ca71f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689098091573; access_time=1689098090753; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-11 17:54:53,342 INFO [Listener at localhost/43271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testGetAfterCompaction/3f2d34aabb76b9d0964d22dd41a84201/f1/0700a6affb144638bd78a7b9b7b7c37b_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1689098092842; access_time=1689098092031; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-07-11 17:54:53,342 INFO [Listener at localhost/43271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testGetAfterCompaction/3f2d34aabb76b9d0964d22dd41a84201/f1/2639ffb08b8b4b2fb5096daa6f126cac; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689098092002; access_time=1689098091588; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-11 17:54:53,342 INFO [Listener at localhost/43271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testGetAfterCompaction/3f2d34aabb76b9d0964d22dd41a84201/f1/68f95eec3d0449dc87810762723ca71f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689098091573; access_time=1689098090753; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-11 17:54:53,393 INFO [Listener at localhost/43271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testGetAfterCompaction/3f2d34aabb76b9d0964d22dd41a84201/f1/0700a6affb144638bd78a7b9b7b7c37b_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1689098092842; access_time=1689098092031; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-07-11 17:54:53,393 INFO [Listener at localhost/43271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testGetAfterCompaction/3f2d34aabb76b9d0964d22dd41a84201/f1/2639ffb08b8b4b2fb5096daa6f126cac; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689098092002; access_time=1689098091588; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-11 17:54:53,393 INFO [Listener at localhost/43271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testGetAfterCompaction/3f2d34aabb76b9d0964d22dd41a84201/f1/68f95eec3d0449dc87810762723ca71f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689098091573; access_time=1689098090753; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-11 17:54:53,444 INFO [Listener at localhost/43271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testGetAfterCompaction/3f2d34aabb76b9d0964d22dd41a84201/f1/0700a6affb144638bd78a7b9b7b7c37b_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1689098092842; access_time=1689098092031; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-07-11 17:54:53,444 INFO [Listener at localhost/43271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testGetAfterCompaction/3f2d34aabb76b9d0964d22dd41a84201/f1/2639ffb08b8b4b2fb5096daa6f126cac; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689098092002; access_time=1689098091588; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-11 17:54:53,444 INFO [Listener at localhost/43271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testGetAfterCompaction/3f2d34aabb76b9d0964d22dd41a84201/f1/68f95eec3d0449dc87810762723ca71f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689098091573; access_time=1689098090753; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-11 17:54:53,495 INFO [Listener at localhost/43271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testGetAfterCompaction/3f2d34aabb76b9d0964d22dd41a84201/f1/0700a6affb144638bd78a7b9b7b7c37b_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1689098092842; access_time=1689098092031; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-07-11 17:54:53,495 INFO [Listener at localhost/43271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testGetAfterCompaction/3f2d34aabb76b9d0964d22dd41a84201/f1/2639ffb08b8b4b2fb5096daa6f126cac; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689098092002; access_time=1689098091588; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-11 17:54:53,495 INFO [Listener at localhost/43271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testGetAfterCompaction/3f2d34aabb76b9d0964d22dd41a84201/f1/68f95eec3d0449dc87810762723ca71f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689098091573; access_time=1689098090753; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-11 17:54:53,546 INFO [Listener at localhost/43271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testGetAfterCompaction/3f2d34aabb76b9d0964d22dd41a84201/f1/0700a6affb144638bd78a7b9b7b7c37b_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1689098092842; access_time=1689098092031; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-07-11 17:54:53,546 INFO [Listener at localhost/43271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testGetAfterCompaction/3f2d34aabb76b9d0964d22dd41a84201/f1/2639ffb08b8b4b2fb5096daa6f126cac; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689098092002; access_time=1689098091588; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-11 17:54:53,546 INFO [Listener at localhost/43271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testGetAfterCompaction/3f2d34aabb76b9d0964d22dd41a84201/f1/68f95eec3d0449dc87810762723ca71f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689098091573; access_time=1689098090753; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-11 17:54:53,597 INFO [Listener at localhost/43271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testGetAfterCompaction/3f2d34aabb76b9d0964d22dd41a84201/f1/0700a6affb144638bd78a7b9b7b7c37b_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1689098092842; access_time=1689098092031; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-07-11 17:54:53,597 INFO [Listener at localhost/43271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testGetAfterCompaction/3f2d34aabb76b9d0964d22dd41a84201/f1/2639ffb08b8b4b2fb5096daa6f126cac; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689098092002; access_time=1689098091588; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-11 17:54:53,597 INFO [Listener at localhost/43271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testGetAfterCompaction/3f2d34aabb76b9d0964d22dd41a84201/f1/68f95eec3d0449dc87810762723ca71f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689098091573; access_time=1689098090753; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-11 17:54:53,647 INFO [Listener at localhost/43271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testGetAfterCompaction/3f2d34aabb76b9d0964d22dd41a84201/f1/0700a6affb144638bd78a7b9b7b7c37b_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1689098092842; access_time=1689098092031; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-07-11 17:54:53,647 INFO [Listener at localhost/43271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testGetAfterCompaction/3f2d34aabb76b9d0964d22dd41a84201/f1/2639ffb08b8b4b2fb5096daa6f126cac; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689098092002; access_time=1689098091588; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-11 17:54:53,648 INFO [Listener at localhost/43271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testGetAfterCompaction/3f2d34aabb76b9d0964d22dd41a84201/f1/68f95eec3d0449dc87810762723ca71f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689098091573; access_time=1689098090753; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-11 17:54:53,698 INFO [Listener at localhost/43271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testGetAfterCompaction/3f2d34aabb76b9d0964d22dd41a84201/f1/0700a6affb144638bd78a7b9b7b7c37b_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1689098092842; access_time=1689098092031; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-07-11 17:54:53,698 INFO [Listener at localhost/43271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testGetAfterCompaction/3f2d34aabb76b9d0964d22dd41a84201/f1/2639ffb08b8b4b2fb5096daa6f126cac; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689098092002; access_time=1689098091588; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-11 17:54:53,698 INFO [Listener at localhost/43271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testGetAfterCompaction/3f2d34aabb76b9d0964d22dd41a84201/f1/68f95eec3d0449dc87810762723ca71f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689098091573; access_time=1689098090753; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-11 17:54:53,717 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testGetAfterCompaction/3f2d34aabb76b9d0964d22dd41a84201/.tmp/f1/87072314a4fc48c08504e226495bf150 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testGetAfterCompaction/3f2d34aabb76b9d0964d22dd41a84201/f1/87072314a4fc48c08504e226495bf150 2023-07-11 17:54:53,721 INFO [RS:0;jenkins-hbase9:45839-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 2 file(s) in 3f2d34aabb76b9d0964d22dd41a84201/f1 of 3f2d34aabb76b9d0964d22dd41a84201 into 87072314a4fc48c08504e226495bf150(size=5.1 K), total size for store is 10.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-11 17:54:53,721 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 3f2d34aabb76b9d0964d22dd41a84201: 2023-07-11 17:54:53,721 INFO [RS:0;jenkins-hbase9:45839-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testGetAfterCompaction,,1689098089617.3f2d34aabb76b9d0964d22dd41a84201., storeName=f1, fileCount=2, fileSize=10.0 K (4.9 K, 5.1 K), priority=2, time=1689098092894; duration=0sec 2023-07-11 17:54:53,721 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-11 17:54:53,736 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testGetAfterCompaction/3f2d34aabb76b9d0964d22dd41a84201/f1/2639ffb08b8b4b2fb5096daa6f126cac, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testGetAfterCompaction/3f2d34aabb76b9d0964d22dd41a84201/f1/0700a6affb144638bd78a7b9b7b7c37b_SeqId_12_] to archive 2023-07-11 17:54:53,736 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 17:54:53,738 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testGetAfterCompaction/3f2d34aabb76b9d0964d22dd41a84201/f1/2639ffb08b8b4b2fb5096daa6f126cac to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testGetAfterCompaction/3f2d34aabb76b9d0964d22dd41a84201/f1/2639ffb08b8b4b2fb5096daa6f126cac 2023-07-11 17:54:53,739 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testGetAfterCompaction/3f2d34aabb76b9d0964d22dd41a84201/f1/0700a6affb144638bd78a7b9b7b7c37b_SeqId_12_ to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testGetAfterCompaction/3f2d34aabb76b9d0964d22dd41a84201/f1/0700a6affb144638bd78a7b9b7b7c37b_SeqId_12_ 2023-07-11 17:54:53,749 INFO [Listener at localhost/43271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testGetAfterCompaction/3f2d34aabb76b9d0964d22dd41a84201/f1/68f95eec3d0449dc87810762723ca71f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1689098091573; access_time=1689098090753; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-11 17:54:53,749 INFO [Listener at localhost/43271] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testGetAfterCompaction/3f2d34aabb76b9d0964d22dd41a84201/f1/87072314a4fc48c08504e226495bf150; isDirectory=false; length=5228; replication=1; blocksize=134217728; modification_time=1689098093711; access_time=1689098092899; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-07-11 17:54:53,864 INFO [Listener at localhost/43271] client.HBaseAdmin$15(890): Started disable of testGetAfterCompaction 2023-07-11 17:54:53,868 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.HMaster$11(2418): Client=jenkins//172.31.2.10 disable testGetAfterCompaction 2023-07-11 17:54:53,874 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure2.ProcedureExecutor(1029): Stored pid=75, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testGetAfterCompaction 2023-07-11 17:54:53,876 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689098093876"}]},"ts":"1689098093876"} 2023-07-11 17:54:53,877 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1230): Checking to see if procedure is done pid=75 2023-07-11 17:54:53,878 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=DISABLING in hbase:meta 2023-07-11 17:54:53,879 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testGetAfterCompaction to state=DISABLING 2023-07-11 17:54:53,880 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=75, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testGetAfterCompaction, region=3f2d34aabb76b9d0964d22dd41a84201, UNASSIGN}] 2023-07-11 17:54:53,882 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=75, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testGetAfterCompaction, region=3f2d34aabb76b9d0964d22dd41a84201, UNASSIGN 2023-07-11 17:54:53,882 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=3f2d34aabb76b9d0964d22dd41a84201, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:53,882 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testGetAfterCompaction,,1689098089617.3f2d34aabb76b9d0964d22dd41a84201.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1689098093882"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689098093882"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689098093882"}]},"ts":"1689098093882"} 2023-07-11 17:54:53,884 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; CloseRegionProcedure 3f2d34aabb76b9d0964d22dd41a84201, server=jenkins-hbase9.apache.org,45839,1689097999112}] 2023-07-11 17:54:53,978 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1230): Checking to see if procedure is done pid=75 2023-07-11 17:54:54,035 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 3f2d34aabb76b9d0964d22dd41a84201 2023-07-11 17:54:54,036 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 3f2d34aabb76b9d0964d22dd41a84201, disabling compactions & flushes 2023-07-11 17:54:54,036 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testGetAfterCompaction,,1689098089617.3f2d34aabb76b9d0964d22dd41a84201. 2023-07-11 17:54:54,036 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testGetAfterCompaction,,1689098089617.3f2d34aabb76b9d0964d22dd41a84201. 2023-07-11 17:54:54,036 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testGetAfterCompaction,,1689098089617.3f2d34aabb76b9d0964d22dd41a84201. after waiting 0 ms 2023-07-11 17:54:54,036 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testGetAfterCompaction,,1689098089617.3f2d34aabb76b9d0964d22dd41a84201. 2023-07-11 17:54:54,039 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testGetAfterCompaction/3f2d34aabb76b9d0964d22dd41a84201/recovered.edits/15.seqid, newMaxSeqId=15, maxSeqId=1 2023-07-11 17:54:54,040 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro 2023-07-11 17:54:54,041 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testGetAfterCompaction,,1689098089617.3f2d34aabb76b9d0964d22dd41a84201. 2023-07-11 17:54:54,041 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 3f2d34aabb76b9d0964d22dd41a84201: 2023-07-11 17:54:54,042 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 3f2d34aabb76b9d0964d22dd41a84201 2023-07-11 17:54:54,042 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=3f2d34aabb76b9d0964d22dd41a84201, regionState=CLOSED 2023-07-11 17:54:54,043 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testGetAfterCompaction,,1689098089617.3f2d34aabb76b9d0964d22dd41a84201.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1689098094042"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689098094042"}]},"ts":"1689098094042"} 2023-07-11 17:54:54,045 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-07-11 17:54:54,045 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; CloseRegionProcedure 3f2d34aabb76b9d0964d22dd41a84201, server=jenkins-hbase9.apache.org,45839,1689097999112 in 160 msec 2023-07-11 17:54:54,046 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=75 2023-07-11 17:54:54,046 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=75, state=SUCCESS; TransitRegionStateProcedure table=testGetAfterCompaction, region=3f2d34aabb76b9d0964d22dd41a84201, UNASSIGN in 165 msec 2023-07-11 17:54:54,046 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689098094046"}]},"ts":"1689098094046"} 2023-07-11 17:54:54,047 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=DISABLED in hbase:meta 2023-07-11 17:54:54,053 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testGetAfterCompaction to state=DISABLED 2023-07-11 17:54:54,054 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=75, state=SUCCESS; DisableTableProcedure table=testGetAfterCompaction in 183 msec 2023-07-11 17:54:54,179 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1230): Checking to see if procedure is done pid=75 2023-07-11 17:54:54,180 INFO [Listener at localhost/43271] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testGetAfterCompaction, procId: 75 completed 2023-07-11 17:54:54,184 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.HMaster$5(2228): Client=jenkins//172.31.2.10 delete testGetAfterCompaction 2023-07-11 17:54:54,190 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testGetAfterCompaction 2023-07-11 17:54:54,191 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=78, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-07-11 17:54:54,193 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=78, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-07-11 17:54:54,194 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1230): Checking to see if procedure is done pid=78 2023-07-11 17:54:54,196 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/.tmp/data/default/testGetAfterCompaction/3f2d34aabb76b9d0964d22dd41a84201 2023-07-11 17:54:54,198 DEBUG [HFileArchiver-12] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/.tmp/data/default/testGetAfterCompaction/3f2d34aabb76b9d0964d22dd41a84201/f1, FileablePath, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/.tmp/data/default/testGetAfterCompaction/3f2d34aabb76b9d0964d22dd41a84201/recovered.edits] 2023-07-11 17:54:54,202 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/.tmp/data/default/testGetAfterCompaction/3f2d34aabb76b9d0964d22dd41a84201/f1/68f95eec3d0449dc87810762723ca71f to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testGetAfterCompaction/3f2d34aabb76b9d0964d22dd41a84201/f1/68f95eec3d0449dc87810762723ca71f 2023-07-11 17:54:54,203 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/.tmp/data/default/testGetAfterCompaction/3f2d34aabb76b9d0964d22dd41a84201/f1/87072314a4fc48c08504e226495bf150 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testGetAfterCompaction/3f2d34aabb76b9d0964d22dd41a84201/f1/87072314a4fc48c08504e226495bf150 2023-07-11 17:54:54,205 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/.tmp/data/default/testGetAfterCompaction/3f2d34aabb76b9d0964d22dd41a84201/recovered.edits/15.seqid to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testGetAfterCompaction/3f2d34aabb76b9d0964d22dd41a84201/recovered.edits/15.seqid 2023-07-11 17:54:54,205 DEBUG [HFileArchiver-12] backup.HFileArchiver(596): Deleted hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/.tmp/data/default/testGetAfterCompaction/3f2d34aabb76b9d0964d22dd41a84201 2023-07-11 17:54:54,205 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testGetAfterCompaction regions 2023-07-11 17:54:54,206 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0 2023-07-11 17:54:54,206 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1] 2023-07-11 17:54:54,209 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230711f7c58fac5f7d4c9c80090f427a35d2b7 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230711f7c58fac5f7d4c9c80090f427a35d2b7 2023-07-11 17:54:54,210 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0 2023-07-11 17:54:54,212 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=78, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-07-11 17:54:54,233 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testGetAfterCompaction from hbase:meta 2023-07-11 17:54:54,235 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testGetAfterCompaction' descriptor. 2023-07-11 17:54:54,236 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=78, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-07-11 17:54:54,236 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testGetAfterCompaction' from region states. 2023-07-11 17:54:54,237 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testGetAfterCompaction,,1689098089617.3f2d34aabb76b9d0964d22dd41a84201.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689098094236"}]},"ts":"9223372036854775807"} 2023-07-11 17:54:54,238 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-07-11 17:54:54,238 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 3f2d34aabb76b9d0964d22dd41a84201, NAME => 'testGetAfterCompaction,,1689098089617.3f2d34aabb76b9d0964d22dd41a84201.', STARTKEY => '', ENDKEY => ''}] 2023-07-11 17:54:54,238 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testGetAfterCompaction' as deleted. 2023-07-11 17:54:54,238 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689098094238"}]},"ts":"9223372036854775807"} 2023-07-11 17:54:54,240 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testGetAfterCompaction state from META 2023-07-11 17:54:54,241 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=78, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-07-11 17:54:54,243 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; DeleteTableProcedure table=testGetAfterCompaction in 57 msec 2023-07-11 17:54:54,294 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1230): Checking to see if procedure is done pid=78 2023-07-11 17:54:54,295 INFO [Listener at localhost/43271] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testGetAfterCompaction, procId: 78 completed 2023-07-11 17:54:54,309 INFO [Listener at localhost/43271] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testGetAfterCompaction Thread=255 (was 249) - Thread LEAK? -, OpenFileDescriptor=650 (was 644) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=261 (was 197) - SystemLoadAverage LEAK? -, ProcessCount=170 (was 170), AvailableMemoryMB=8342 (was 8366) 2023-07-11 17:54:54,323 INFO [Listener at localhost/43271] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testCompactionWithHFileLink Thread=255, OpenFileDescriptor=650, MaxFileDescriptor=60000, SystemLoadAverage=261, ProcessCount=170, AvailableMemoryMB=8341 2023-07-11 17:54:54,326 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-11 17:54:54,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testCompactionWithHFileLink 2023-07-11 17:54:54,328 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_PRE_OPERATION 2023-07-11 17:54:54,328 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testCompactionWithHFileLink" procId is: 79 2023-07-11 17:54:54,329 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-11 17:54:54,329 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-07-11 17:54:54,331 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/.tmp/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7 2023-07-11 17:54:54,331 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/.tmp/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b 2023-07-11 17:54:54,331 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/.tmp/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95 2023-07-11 17:54:54,332 DEBUG [HFileArchiver-13] backup.HFileArchiver(153): Directory hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/.tmp/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7 empty. 2023-07-11 17:54:54,333 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/.tmp/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95 empty. 2023-07-11 17:54:54,333 DEBUG [HFileArchiver-14] backup.HFileArchiver(153): Directory hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/.tmp/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b empty. 2023-07-11 17:54:54,338 DEBUG [HFileArchiver-13] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/.tmp/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7 2023-07-11 17:54:54,338 DEBUG [HFileArchiver-14] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/.tmp/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b 2023-07-11 17:54:54,339 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/.tmp/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95 2023-07-11 17:54:54,339 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testCompactionWithHFileLink regions 2023-07-11 17:54:54,430 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-07-11 17:54:54,631 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-07-11 17:54:54,752 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/.tmp/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000001 2023-07-11 17:54:54,754 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(7675): creating {ENCODED => c13bb432df8709c95734bd08b015997b, NAME => 'testCompactionWithHFileLink,1,1689098094325.c13bb432df8709c95734bd08b015997b.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/.tmp 2023-07-11 17:54:54,754 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(7675): creating {ENCODED => 0b68e8a6a3555cdd10a16d0303c35da7, NAME => 'testCompactionWithHFileLink,,1689098094325.0b68e8a6a3555cdd10a16d0303c35da7.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/.tmp 2023-07-11 17:54:54,754 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(7675): creating {ENCODED => 17aacf583da279539e944e5353cb4f95, NAME => 'testCompactionWithHFileLink,2,1689098094325.17aacf583da279539e944e5353cb4f95.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/.tmp 2023-07-11 17:54:54,932 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-07-11 17:54:55,160 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,1,1689098094325.c13bb432df8709c95734bd08b015997b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 17:54:55,160 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,,1689098094325.0b68e8a6a3555cdd10a16d0303c35da7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 17:54:55,160 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,2,1689098094325.17aacf583da279539e944e5353cb4f95.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 17:54:55,160 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1604): Closing 0b68e8a6a3555cdd10a16d0303c35da7, disabling compactions & flushes 2023-07-11 17:54:55,160 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1604): Closing 17aacf583da279539e944e5353cb4f95, disabling compactions & flushes 2023-07-11 17:54:55,160 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1604): Closing c13bb432df8709c95734bd08b015997b, disabling compactions & flushes 2023-07-11 17:54:55,160 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,2,1689098094325.17aacf583da279539e944e5353cb4f95. 2023-07-11 17:54:55,160 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1689098094325.17aacf583da279539e944e5353cb4f95. 2023-07-11 17:54:55,160 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,,1689098094325.0b68e8a6a3555cdd10a16d0303c35da7. 2023-07-11 17:54:55,160 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,,1689098094325.0b68e8a6a3555cdd10a16d0303c35da7. 2023-07-11 17:54:55,160 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,2,1689098094325.17aacf583da279539e944e5353cb4f95. after waiting 0 ms 2023-07-11 17:54:55,160 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,2,1689098094325.17aacf583da279539e944e5353cb4f95. 2023-07-11 17:54:55,160 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,1,1689098094325.c13bb432df8709c95734bd08b015997b. 2023-07-11 17:54:55,160 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1689098094325.c13bb432df8709c95734bd08b015997b. 2023-07-11 17:54:55,161 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,1,1689098094325.c13bb432df8709c95734bd08b015997b. after waiting 0 ms 2023-07-11 17:54:55,161 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,1,1689098094325.c13bb432df8709c95734bd08b015997b. 2023-07-11 17:54:55,160 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,2,1689098094325.17aacf583da279539e944e5353cb4f95. 2023-07-11 17:54:55,160 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,,1689098094325.0b68e8a6a3555cdd10a16d0303c35da7. after waiting 0 ms 2023-07-11 17:54:55,161 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,,1689098094325.0b68e8a6a3555cdd10a16d0303c35da7. 2023-07-11 17:54:55,161 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1558): Region close journal for 17aacf583da279539e944e5353cb4f95: 2023-07-11 17:54:55,161 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,1,1689098094325.c13bb432df8709c95734bd08b015997b. 2023-07-11 17:54:55,161 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,,1689098094325.0b68e8a6a3555cdd10a16d0303c35da7. 2023-07-11 17:54:55,161 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1558): Region close journal for c13bb432df8709c95734bd08b015997b: 2023-07-11 17:54:55,161 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1558): Region close journal for 0b68e8a6a3555cdd10a16d0303c35da7: 2023-07-11 17:54:55,163 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_ADD_TO_META 2023-07-11 17:54:55,163 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1689098094325.17aacf583da279539e944e5353cb4f95.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1689098095163"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689098095163"}]},"ts":"1689098095163"} 2023-07-11 17:54:55,164 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1689098094325.c13bb432df8709c95734bd08b015997b.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1689098095163"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689098095163"}]},"ts":"1689098095163"} 2023-07-11 17:54:55,164 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1689098094325.0b68e8a6a3555cdd10a16d0303c35da7.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1689098095163"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689098095163"}]},"ts":"1689098095163"} 2023-07-11 17:54:55,165 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-07-11 17:54:55,166 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-11 17:54:55,166 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689098095166"}]},"ts":"1689098095166"} 2023-07-11 17:54:55,167 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLING in hbase:meta 2023-07-11 17:54:55,172 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=0b68e8a6a3555cdd10a16d0303c35da7, ASSIGN}, {pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=c13bb432df8709c95734bd08b015997b, ASSIGN}, {pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=17aacf583da279539e944e5353cb4f95, ASSIGN}] 2023-07-11 17:54:55,173 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=c13bb432df8709c95734bd08b015997b, ASSIGN 2023-07-11 17:54:55,173 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=0b68e8a6a3555cdd10a16d0303c35da7, ASSIGN 2023-07-11 17:54:55,173 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=17aacf583da279539e944e5353cb4f95, ASSIGN 2023-07-11 17:54:55,174 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=17aacf583da279539e944e5353cb4f95, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,45839,1689097999112; forceNewPlan=false, retain=false 2023-07-11 17:54:55,174 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=c13bb432df8709c95734bd08b015997b, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,45839,1689097999112; forceNewPlan=false, retain=false 2023-07-11 17:54:55,174 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=0b68e8a6a3555cdd10a16d0303c35da7, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,45839,1689097999112; forceNewPlan=false, retain=false 2023-07-11 17:54:55,325 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=82 updating hbase:meta row=17aacf583da279539e944e5353cb4f95, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:55,325 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=c13bb432df8709c95734bd08b015997b, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:55,325 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=80 updating hbase:meta row=0b68e8a6a3555cdd10a16d0303c35da7, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:55,326 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1689098094325.17aacf583da279539e944e5353cb4f95.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1689098095325"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689098095325"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689098095325"}]},"ts":"1689098095325"} 2023-07-11 17:54:55,326 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1689098094325.0b68e8a6a3555cdd10a16d0303c35da7.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1689098095325"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689098095325"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689098095325"}]},"ts":"1689098095325"} 2023-07-11 17:54:55,326 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1689098094325.c13bb432df8709c95734bd08b015997b.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1689098095325"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689098095325"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689098095325"}]},"ts":"1689098095325"} 2023-07-11 17:54:55,328 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=83, ppid=82, state=RUNNABLE; OpenRegionProcedure 17aacf583da279539e944e5353cb4f95, server=jenkins-hbase9.apache.org,45839,1689097999112}] 2023-07-11 17:54:55,328 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=84, ppid=80, state=RUNNABLE; OpenRegionProcedure 0b68e8a6a3555cdd10a16d0303c35da7, server=jenkins-hbase9.apache.org,45839,1689097999112}] 2023-07-11 17:54:55,330 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=81, state=RUNNABLE; OpenRegionProcedure c13bb432df8709c95734bd08b015997b, server=jenkins-hbase9.apache.org,45839,1689097999112}] 2023-07-11 17:54:55,433 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-07-11 17:54:55,483 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,2,1689098094325.17aacf583da279539e944e5353cb4f95. 2023-07-11 17:54:55,484 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 17aacf583da279539e944e5353cb4f95, NAME => 'testCompactionWithHFileLink,2,1689098094325.17aacf583da279539e944e5353cb4f95.', STARTKEY => '2', ENDKEY => ''} 2023-07-11 17:54:55,484 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 17aacf583da279539e944e5353cb4f95 2023-07-11 17:54:55,484 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,2,1689098094325.17aacf583da279539e944e5353cb4f95.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 17:54:55,484 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 17aacf583da279539e944e5353cb4f95 2023-07-11 17:54:55,484 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 17aacf583da279539e944e5353cb4f95 2023-07-11 17:54:55,485 INFO [StoreOpener-17aacf583da279539e944e5353cb4f95-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 17aacf583da279539e944e5353cb4f95 2023-07-11 17:54:55,487 DEBUG [StoreOpener-17aacf583da279539e944e5353cb4f95-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family1 2023-07-11 17:54:55,487 DEBUG [StoreOpener-17aacf583da279539e944e5353cb4f95-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family1 2023-07-11 17:54:55,487 INFO [StoreOpener-17aacf583da279539e944e5353cb4f95-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 17aacf583da279539e944e5353cb4f95 columnFamilyName family1 2023-07-11 17:54:55,489 INFO [StoreOpener-17aacf583da279539e944e5353cb4f95-1] regionserver.HStore(310): Store=17aacf583da279539e944e5353cb4f95/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 17:54:55,489 INFO [StoreOpener-17aacf583da279539e944e5353cb4f95-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 17aacf583da279539e944e5353cb4f95 2023-07-11 17:54:55,490 DEBUG [StoreOpener-17aacf583da279539e944e5353cb4f95-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family2 2023-07-11 17:54:55,490 DEBUG [StoreOpener-17aacf583da279539e944e5353cb4f95-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family2 2023-07-11 17:54:55,490 INFO [StoreOpener-17aacf583da279539e944e5353cb4f95-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 17aacf583da279539e944e5353cb4f95 columnFamilyName family2 2023-07-11 17:54:55,491 INFO [StoreOpener-17aacf583da279539e944e5353cb4f95-1] regionserver.HStore(310): Store=17aacf583da279539e944e5353cb4f95/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 17:54:55,492 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95 2023-07-11 17:54:55,493 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95 2023-07-11 17:54:55,494 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-07-11 17:54:55,495 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 17aacf583da279539e944e5353cb4f95 2023-07-11 17:54:55,497 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 17:54:55,497 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 17aacf583da279539e944e5353cb4f95; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67509582, jitterRate=0.005971163511276245}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-07-11 17:54:55,497 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 17aacf583da279539e944e5353cb4f95: 2023-07-11 17:54:55,498 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,2,1689098094325.17aacf583da279539e944e5353cb4f95., pid=83, masterSystemTime=1689098095481 2023-07-11 17:54:55,499 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,2,1689098094325.17aacf583da279539e944e5353cb4f95. 2023-07-11 17:54:55,499 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,2,1689098094325.17aacf583da279539e944e5353cb4f95. 2023-07-11 17:54:55,500 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,,1689098094325.0b68e8a6a3555cdd10a16d0303c35da7. 2023-07-11 17:54:55,500 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0b68e8a6a3555cdd10a16d0303c35da7, NAME => 'testCompactionWithHFileLink,,1689098094325.0b68e8a6a3555cdd10a16d0303c35da7.', STARTKEY => '', ENDKEY => '1'} 2023-07-11 17:54:55,500 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=82 updating hbase:meta row=17aacf583da279539e944e5353cb4f95, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:55,500 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 0b68e8a6a3555cdd10a16d0303c35da7 2023-07-11 17:54:55,500 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,,1689098094325.0b68e8a6a3555cdd10a16d0303c35da7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 17:54:55,500 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,2,1689098094325.17aacf583da279539e944e5353cb4f95.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1689098095500"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689098095500"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689098095500"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689098095500"}]},"ts":"1689098095500"} 2023-07-11 17:54:55,500 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 0b68e8a6a3555cdd10a16d0303c35da7 2023-07-11 17:54:55,500 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 0b68e8a6a3555cdd10a16d0303c35da7 2023-07-11 17:54:55,501 INFO [StoreOpener-0b68e8a6a3555cdd10a16d0303c35da7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 0b68e8a6a3555cdd10a16d0303c35da7 2023-07-11 17:54:55,503 DEBUG [StoreOpener-0b68e8a6a3555cdd10a16d0303c35da7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family1 2023-07-11 17:54:55,503 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=83, resume processing ppid=82 2023-07-11 17:54:55,503 DEBUG [StoreOpener-0b68e8a6a3555cdd10a16d0303c35da7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family1 2023-07-11 17:54:55,503 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=83, ppid=82, state=SUCCESS; OpenRegionProcedure 17aacf583da279539e944e5353cb4f95, server=jenkins-hbase9.apache.org,45839,1689097999112 in 173 msec 2023-07-11 17:54:55,503 INFO [StoreOpener-0b68e8a6a3555cdd10a16d0303c35da7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0b68e8a6a3555cdd10a16d0303c35da7 columnFamilyName family1 2023-07-11 17:54:55,504 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=17aacf583da279539e944e5353cb4f95, ASSIGN in 331 msec 2023-07-11 17:54:55,504 INFO [StoreOpener-0b68e8a6a3555cdd10a16d0303c35da7-1] regionserver.HStore(310): Store=0b68e8a6a3555cdd10a16d0303c35da7/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 17:54:55,504 INFO [StoreOpener-0b68e8a6a3555cdd10a16d0303c35da7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 0b68e8a6a3555cdd10a16d0303c35da7 2023-07-11 17:54:55,505 DEBUG [StoreOpener-0b68e8a6a3555cdd10a16d0303c35da7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family2 2023-07-11 17:54:55,505 DEBUG [StoreOpener-0b68e8a6a3555cdd10a16d0303c35da7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family2 2023-07-11 17:54:55,506 INFO [StoreOpener-0b68e8a6a3555cdd10a16d0303c35da7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0b68e8a6a3555cdd10a16d0303c35da7 columnFamilyName family2 2023-07-11 17:54:55,506 INFO [StoreOpener-0b68e8a6a3555cdd10a16d0303c35da7-1] regionserver.HStore(310): Store=0b68e8a6a3555cdd10a16d0303c35da7/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 17:54:55,507 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7 2023-07-11 17:54:55,508 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7 2023-07-11 17:54:55,509 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-07-11 17:54:55,510 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 0b68e8a6a3555cdd10a16d0303c35da7 2023-07-11 17:54:55,512 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 17:54:55,512 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 0b68e8a6a3555cdd10a16d0303c35da7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61561340, jitterRate=-0.08266454935073853}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-07-11 17:54:55,512 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 0b68e8a6a3555cdd10a16d0303c35da7: 2023-07-11 17:54:55,513 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,,1689098094325.0b68e8a6a3555cdd10a16d0303c35da7., pid=84, masterSystemTime=1689098095481 2023-07-11 17:54:55,514 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,,1689098094325.0b68e8a6a3555cdd10a16d0303c35da7. 2023-07-11 17:54:55,514 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,,1689098094325.0b68e8a6a3555cdd10a16d0303c35da7. 2023-07-11 17:54:55,514 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,1,1689098094325.c13bb432df8709c95734bd08b015997b. 2023-07-11 17:54:55,514 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c13bb432df8709c95734bd08b015997b, NAME => 'testCompactionWithHFileLink,1,1689098094325.c13bb432df8709c95734bd08b015997b.', STARTKEY => '1', ENDKEY => '2'} 2023-07-11 17:54:55,514 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=80 updating hbase:meta row=0b68e8a6a3555cdd10a16d0303c35da7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:55,514 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink c13bb432df8709c95734bd08b015997b 2023-07-11 17:54:55,514 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,1,1689098094325.c13bb432df8709c95734bd08b015997b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 17:54:55,514 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for c13bb432df8709c95734bd08b015997b 2023-07-11 17:54:55,514 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for c13bb432df8709c95734bd08b015997b 2023-07-11 17:54:55,515 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,,1689098094325.0b68e8a6a3555cdd10a16d0303c35da7.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1689098095514"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689098095514"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689098095514"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689098095514"}]},"ts":"1689098095514"} 2023-07-11 17:54:55,515 INFO [StoreOpener-c13bb432df8709c95734bd08b015997b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region c13bb432df8709c95734bd08b015997b 2023-07-11 17:54:55,517 DEBUG [StoreOpener-c13bb432df8709c95734bd08b015997b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family1 2023-07-11 17:54:55,517 DEBUG [StoreOpener-c13bb432df8709c95734bd08b015997b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family1 2023-07-11 17:54:55,517 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=84, resume processing ppid=80 2023-07-11 17:54:55,517 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=84, ppid=80, state=SUCCESS; OpenRegionProcedure 0b68e8a6a3555cdd10a16d0303c35da7, server=jenkins-hbase9.apache.org,45839,1689097999112 in 188 msec 2023-07-11 17:54:55,517 INFO [StoreOpener-c13bb432df8709c95734bd08b015997b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c13bb432df8709c95734bd08b015997b columnFamilyName family1 2023-07-11 17:54:55,518 INFO [StoreOpener-c13bb432df8709c95734bd08b015997b-1] regionserver.HStore(310): Store=c13bb432df8709c95734bd08b015997b/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 17:54:55,518 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=80, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=0b68e8a6a3555cdd10a16d0303c35da7, ASSIGN in 347 msec 2023-07-11 17:54:55,518 INFO [StoreOpener-c13bb432df8709c95734bd08b015997b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region c13bb432df8709c95734bd08b015997b 2023-07-11 17:54:55,520 DEBUG [StoreOpener-c13bb432df8709c95734bd08b015997b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family2 2023-07-11 17:54:55,520 DEBUG [StoreOpener-c13bb432df8709c95734bd08b015997b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family2 2023-07-11 17:54:55,520 INFO [StoreOpener-c13bb432df8709c95734bd08b015997b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c13bb432df8709c95734bd08b015997b columnFamilyName family2 2023-07-11 17:54:55,521 INFO [StoreOpener-c13bb432df8709c95734bd08b015997b-1] regionserver.HStore(310): Store=c13bb432df8709c95734bd08b015997b/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 17:54:55,522 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b 2023-07-11 17:54:55,522 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b 2023-07-11 17:54:55,523 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-07-11 17:54:55,524 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for c13bb432df8709c95734bd08b015997b 2023-07-11 17:54:55,526 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 17:54:55,526 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened c13bb432df8709c95734bd08b015997b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59291472, jitterRate=-0.11648821830749512}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-07-11 17:54:55,526 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for c13bb432df8709c95734bd08b015997b: 2023-07-11 17:54:55,527 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,1,1689098094325.c13bb432df8709c95734bd08b015997b., pid=85, masterSystemTime=1689098095481 2023-07-11 17:54:55,528 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,1,1689098094325.c13bb432df8709c95734bd08b015997b. 2023-07-11 17:54:55,528 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,1,1689098094325.c13bb432df8709c95734bd08b015997b. 2023-07-11 17:54:55,528 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=c13bb432df8709c95734bd08b015997b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:55,529 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,1,1689098094325.c13bb432df8709c95734bd08b015997b.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1689098095528"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689098095528"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689098095528"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689098095528"}]},"ts":"1689098095528"} 2023-07-11 17:54:55,531 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=85, resume processing ppid=81 2023-07-11 17:54:55,531 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=81, state=SUCCESS; OpenRegionProcedure c13bb432df8709c95734bd08b015997b, server=jenkins-hbase9.apache.org,45839,1689097999112 in 201 msec 2023-07-11 17:54:55,532 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=81, resume processing ppid=79 2023-07-11 17:54:55,532 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=c13bb432df8709c95734bd08b015997b, ASSIGN in 361 msec 2023-07-11 17:54:55,532 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-11 17:54:55,533 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689098095533"}]},"ts":"1689098095533"} 2023-07-11 17:54:55,533 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLED in hbase:meta 2023-07-11 17:54:55,536 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_POST_OPERATION 2023-07-11 17:54:55,537 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; CreateTableProcedure table=testCompactionWithHFileLink in 1.2100 sec 2023-07-11 17:54:56,370 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testCompactionWithHFileLink' 2023-07-11 17:54:56,434 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-07-11 17:54:56,434 INFO [Listener at localhost/43271] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testCompactionWithHFileLink, procId: 79 completed 2023-07-11 17:54:56,441 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1689098094325.0b68e8a6a3555cdd10a16d0303c35da7. with WAL disabled. Data may be lost in the event of a crash. 2023-07-11 17:54:56,442 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1689098094325.c13bb432df8709c95734bd08b015997b. with WAL disabled. Data may be lost in the event of a crash. 2023-07-11 17:54:56,443 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1689098094325.17aacf583da279539e944e5353cb4f95. with WAL disabled. Data may be lost in the event of a crash. 2023-07-11 17:54:56,445 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 17:54:56,447 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-07-11 17:54:56,447 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-07-11 17:54:56,447 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:54:56,447 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-07-11 17:54:56,447 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-07-11 17:54:56,447 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-07-11 17:54:56,447 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-07-11 17:54:56,448 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:54:56,448 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:56,448 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:54:56,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:54:56,449 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:56,449 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 17:54:56,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-07-11 17:54:56,449 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-07-11 17:54:56,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 17:54:56,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-07-11 17:54:56,449 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-07-11 17:54:56,450 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-07-11 17:54:56,450 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-07-11 17:54:56,450 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:54:56,450 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-07-11 17:54:56,450 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1689098094325.17aacf583da279539e944e5353cb4f95. 2023-07-11 17:54:56,450 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1689098094325.17aacf583da279539e944e5353cb4f95. started... 2023-07-11 17:54:56,450 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1689098094325.c13bb432df8709c95734bd08b015997b. 2023-07-11 17:54:56,450 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1689098094325.c13bb432df8709c95734bd08b015997b. started... 2023-07-11 17:54:56,450 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-07-11 17:54:56,451 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 17:54:56,451 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 17aacf583da279539e944e5353cb4f95 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-07-11 17:54:56,451 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1689098094325.0b68e8a6a3555cdd10a16d0303c35da7. 2023-07-11 17:54:56,451 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing c13bb432df8709c95734bd08b015997b 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-07-11 17:54:56,451 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1689098094325.0b68e8a6a3555cdd10a16d0303c35da7. started... 2023-07-11 17:54:56,452 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 0b68e8a6a3555cdd10a16d0303c35da7 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-07-11 17:54:56,467 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230711aa14f34b4f9540efbcae4d44c4a026cb to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230711aa14f34b4f9540efbcae4d44c4a026cb 2023-07-11 17:54:56,468 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023071191aac97fa1dc4c54a45b2652468490a8 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023071191aac97fa1dc4c54a45b2652468490a8 2023-07-11 17:54:56,870 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023071159eb6543927c4caebe900be67b0dc8b1 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023071159eb6543927c4caebe900be67b0dc8b1 2023-07-11 17:54:56,875 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/.tmp/family1/5a91189cc1db4a21b3f357d74add3143 2023-07-11 17:54:56,876 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/.tmp/family1/a707ff33e39949af81987160f0ba5530 2023-07-11 17:54:57,275 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/.tmp/family1/76b71e8b082a4db9a277c10783c7028f 2023-07-11 17:54:57,289 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230711beabf5cd3ffa43308073ccb69f996243 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230711beabf5cd3ffa43308073ccb69f996243 2023-07-11 17:54:57,289 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023071151880ab39eb74fcbab8c0532f1534224 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023071151880ab39eb74fcbab8c0532f1534224 2023-07-11 17:54:57,690 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202307118776f0ea9be24e7eb92fb093d0386232 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202307118776f0ea9be24e7eb92fb093d0386232 2023-07-11 17:54:57,694 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/.tmp/family2/93d53e1b8309484aa3e0289e23d040ab 2023-07-11 17:54:57,694 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/.tmp/family2/1f1fcd346abe4a0d82bc870270831a57 2023-07-11 17:54:57,700 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/.tmp/family1/a707ff33e39949af81987160f0ba5530 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family1/a707ff33e39949af81987160f0ba5530 2023-07-11 17:54:57,700 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/.tmp/family1/5a91189cc1db4a21b3f357d74add3143 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family1/5a91189cc1db4a21b3f357d74add3143 2023-07-11 17:54:57,704 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family1/a707ff33e39949af81987160f0ba5530, entries=4, sequenceid=5, filesize=5.4 K 2023-07-11 17:54:57,704 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family1/5a91189cc1db4a21b3f357d74add3143, entries=4, sequenceid=5, filesize=5.4 K 2023-07-11 17:54:57,705 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/.tmp/family2/1f1fcd346abe4a0d82bc870270831a57 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family2/1f1fcd346abe4a0d82bc870270831a57 2023-07-11 17:54:57,705 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/.tmp/family2/93d53e1b8309484aa3e0289e23d040ab as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family2/93d53e1b8309484aa3e0289e23d040ab 2023-07-11 17:54:57,708 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family2/1f1fcd346abe4a0d82bc870270831a57, entries=2, sequenceid=5, filesize=5.1 K 2023-07-11 17:54:57,709 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family2/93d53e1b8309484aa3e0289e23d040ab, entries=2, sequenceid=5, filesize=5.1 K 2023-07-11 17:54:57,709 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 0b68e8a6a3555cdd10a16d0303c35da7 in 1257ms, sequenceid=5, compaction requested=false 2023-07-11 17:54:57,710 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 0b68e8a6a3555cdd10a16d0303c35da7: 2023-07-11 17:54:57,710 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 17aacf583da279539e944e5353cb4f95 in 1259ms, sequenceid=5, compaction requested=false 2023-07-11 17:54:57,710 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1689098094325.0b68e8a6a3555cdd10a16d0303c35da7. 2023-07-11 17:54:57,710 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 17aacf583da279539e944e5353cb4f95: 2023-07-11 17:54:57,710 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-07-11 17:54:57,710 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1689098094325.17aacf583da279539e944e5353cb4f95. 2023-07-11 17:54:57,710 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-07-11 17:54:58,097 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/.tmp/family2/02c2a20c070443429b770182c7743f19 2023-07-11 17:54:58,101 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/.tmp/family1/76b71e8b082a4db9a277c10783c7028f as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family1/76b71e8b082a4db9a277c10783c7028f 2023-07-11 17:54:58,105 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family1/76b71e8b082a4db9a277c10783c7028f, entries=4, sequenceid=5, filesize=5.4 K 2023-07-11 17:54:58,106 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/.tmp/family2/02c2a20c070443429b770182c7743f19 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family2/02c2a20c070443429b770182c7743f19 2023-07-11 17:54:58,109 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family2/02c2a20c070443429b770182c7743f19, entries=2, sequenceid=5, filesize=5.1 K 2023-07-11 17:54:58,110 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for c13bb432df8709c95734bd08b015997b in 1659ms, sequenceid=5, compaction requested=false 2023-07-11 17:54:58,110 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for c13bb432df8709c95734bd08b015997b: 2023-07-11 17:54:58,110 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1689098094325.c13bb432df8709c95734bd08b015997b. 2023-07-11 17:54:58,110 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-07-11 17:54:58,110 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-07-11 17:54:58,110 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:58,110 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-07-11 17:54:58,110 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-07-11 17:54:58,112 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:58,112 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-07-11 17:54:58,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:58,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:54:58,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:54:58,112 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-07-11 17:54:58,112 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 17:54:58,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:54:58,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:54:58,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-07-11 17:54:58,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:58,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:54:58,114 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-07-11 17:54:58,114 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3bce5dd5[Count = 0] remaining members to acquire global barrier 2023-07-11 17:54:58,114 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-07-11 17:54:58,114 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-07-11 17:54:58,115 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-07-11 17:54:58,115 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-07-11 17:54:58,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-07-11 17:54:58,115 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-07-11 17:54:58,115 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-07-11 17:54:58,115 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase9.apache.org,45839,1689097999112' in zk 2023-07-11 17:54:58,115 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:58,115 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 17:54:58,117 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-07-11 17:54:58,117 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:54:58,117 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:58,117 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-07-11 17:54:58,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:58,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:54:58,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:54:58,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:54:58,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:54:58,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-07-11 17:54:58,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:58,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:54:58,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-07-11 17:54:58,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:58,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase9.apache.org,45839,1689097999112': 2023-07-11 17:54:58,119 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-07-11 17:54:58,119 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-07-11 17:54:58,119 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 17:54:58,119 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 17:54:58,119 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-07-11 17:54:58,119 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 17:54:58,120 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-07-11 17:54:58,120 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-07-11 17:54:58,120 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-07-11 17:54:58,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-07-11 17:54:58,120 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:54:58,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-07-11 17:54:58,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:54:58,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:54:58,121 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:54:58,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:54:58,121 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:58,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:54:58,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-07-11 17:54:58,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-07-11 17:54:58,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:54:58,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-07-11 17:54:58,122 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:58,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:58,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:54:58,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-07-11 17:54:58,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:58,124 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:58,124 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:54:58,124 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-07-11 17:54:58,124 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-07-11 17:54:58,124 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:58,124 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:54:58,124 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:54:58,124 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:54:58,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:54:58,124 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-07-11 17:54:58,124 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-07-11 17:54:58,124 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 17:54:58,124 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-07-11 17:54:58,124 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-07-11 17:54:58,124 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-07-11 17:54:58,124 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:54:58,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:54:58,124 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-07-11 17:54:58,125 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 17:54:58,225 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 17:54:58,226 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 17:54:58,227 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1689098094325.0b68e8a6a3555cdd10a16d0303c35da7. with WAL disabled. Data may be lost in the event of a crash. 2023-07-11 17:54:58,227 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1689098094325.c13bb432df8709c95734bd08b015997b. with WAL disabled. Data may be lost in the event of a crash. 2023-07-11 17:54:58,227 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1689098094325.17aacf583da279539e944e5353cb4f95. with WAL disabled. Data may be lost in the event of a crash. 2023-07-11 17:54:58,230 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 17:54:58,232 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-07-11 17:54:58,232 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-07-11 17:54:58,232 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-07-11 17:54:58,232 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:54:58,232 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-07-11 17:54:58,232 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-07-11 17:54:58,232 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-07-11 17:54:58,232 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-07-11 17:54:58,234 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:54:58,234 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:58,234 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:54:58,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:54:58,234 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:58,234 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 17:54:58,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-07-11 17:54:58,234 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-07-11 17:54:58,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 17:54:58,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-07-11 17:54:58,235 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-07-11 17:54:58,235 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-07-11 17:54:58,235 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-07-11 17:54:58,235 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-07-11 17:54:58,235 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:54:58,235 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-07-11 17:54:58,235 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1689098094325.17aacf583da279539e944e5353cb4f95. 2023-07-11 17:54:58,235 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1689098094325.17aacf583da279539e944e5353cb4f95. started... 2023-07-11 17:54:58,235 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-07-11 17:54:58,236 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 17:54:58,235 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1689098094325.c13bb432df8709c95734bd08b015997b. 2023-07-11 17:54:58,236 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1689098094325.c13bb432df8709c95734bd08b015997b. started... 2023-07-11 17:54:58,236 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 17aacf583da279539e944e5353cb4f95 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-07-11 17:54:58,236 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing c13bb432df8709c95734bd08b015997b 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-07-11 17:54:58,236 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1689098094325.0b68e8a6a3555cdd10a16d0303c35da7. 2023-07-11 17:54:58,236 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1689098094325.0b68e8a6a3555cdd10a16d0303c35da7. started... 2023-07-11 17:54:58,236 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 0b68e8a6a3555cdd10a16d0303c35da7 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-07-11 17:54:58,251 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230711677457bc24104b5390bb726bdfdde12d to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230711677457bc24104b5390bb726bdfdde12d 2023-07-11 17:54:58,256 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/.tmp/family1/e23b0c73b533452b95b0ad7a117cc636 2023-07-11 17:54:58,653 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230711d34c31dca08a4a3d87c90aae83c14ab8 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230711d34c31dca08a4a3d87c90aae83c14ab8 2023-07-11 17:54:58,655 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230711dfdabf355e284e7791a42e28492c6e4b to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230711dfdabf355e284e7791a42e28492c6e4b 2023-07-11 17:54:58,663 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/.tmp/family1/ba7bb4ba5b4b4f56bf5eb50df7f9ec97 2023-07-11 17:54:58,671 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230711bb1d4ef0cd35465f80af67cdc07f9227 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230711bb1d4ef0cd35465f80af67cdc07f9227 2023-07-11 17:54:59,061 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/.tmp/family1/30f4c31959d44a41b966543ef2a39e52 2023-07-11 17:54:59,074 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230711f0df82d81bef489ebc1436d7e4ad3d67 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230711f0df82d81bef489ebc1436d7e4ad3d67 2023-07-11 17:54:59,078 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230711532554084d014e04ae1f465a0b0dde54 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230711532554084d014e04ae1f465a0b0dde54 2023-07-11 17:54:59,079 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/.tmp/family2/cccfc7c128044a978c31c85a74c6959a 2023-07-11 17:54:59,083 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/.tmp/family1/e23b0c73b533452b95b0ad7a117cc636 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family1/e23b0c73b533452b95b0ad7a117cc636 2023-07-11 17:54:59,086 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family1/e23b0c73b533452b95b0ad7a117cc636, entries=4, sequenceid=9, filesize=5.4 K 2023-07-11 17:54:59,086 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/.tmp/family2/cccfc7c128044a978c31c85a74c6959a as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family2/cccfc7c128044a978c31c85a74c6959a 2023-07-11 17:54:59,089 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family2/cccfc7c128044a978c31c85a74c6959a, entries=2, sequenceid=9, filesize=5.1 K 2023-07-11 17:54:59,090 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 17aacf583da279539e944e5353cb4f95 in 854ms, sequenceid=9, compaction requested=false 2023-07-11 17:54:59,090 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 17aacf583da279539e944e5353cb4f95: 2023-07-11 17:54:59,090 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1689098094325.17aacf583da279539e944e5353cb4f95. 2023-07-11 17:54:59,090 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-07-11 17:54:59,479 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/.tmp/family2/53a30bd9c0034d4184a04d4074cea82d 2023-07-11 17:54:59,483 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/.tmp/family2/2039c633aed54fb586721637ea9d9e6a 2023-07-11 17:54:59,483 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/.tmp/family1/30f4c31959d44a41b966543ef2a39e52 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family1/30f4c31959d44a41b966543ef2a39e52 2023-07-11 17:54:59,487 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family1/30f4c31959d44a41b966543ef2a39e52, entries=4, sequenceid=9, filesize=5.4 K 2023-07-11 17:54:59,488 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/.tmp/family2/53a30bd9c0034d4184a04d4074cea82d as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family2/53a30bd9c0034d4184a04d4074cea82d 2023-07-11 17:54:59,491 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/.tmp/family1/ba7bb4ba5b4b4f56bf5eb50df7f9ec97 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family1/ba7bb4ba5b4b4f56bf5eb50df7f9ec97 2023-07-11 17:54:59,493 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family2/53a30bd9c0034d4184a04d4074cea82d, entries=2, sequenceid=9, filesize=5.1 K 2023-07-11 17:54:59,493 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for c13bb432df8709c95734bd08b015997b in 1257ms, sequenceid=9, compaction requested=false 2023-07-11 17:54:59,493 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for c13bb432df8709c95734bd08b015997b: 2023-07-11 17:54:59,493 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1689098094325.c13bb432df8709c95734bd08b015997b. 2023-07-11 17:54:59,493 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-07-11 17:54:59,495 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family1/ba7bb4ba5b4b4f56bf5eb50df7f9ec97, entries=4, sequenceid=9, filesize=5.4 K 2023-07-11 17:54:59,496 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/.tmp/family2/2039c633aed54fb586721637ea9d9e6a as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family2/2039c633aed54fb586721637ea9d9e6a 2023-07-11 17:54:59,500 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family2/2039c633aed54fb586721637ea9d9e6a, entries=2, sequenceid=9, filesize=5.1 K 2023-07-11 17:54:59,501 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 0b68e8a6a3555cdd10a16d0303c35da7 in 1265ms, sequenceid=9, compaction requested=false 2023-07-11 17:54:59,501 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 0b68e8a6a3555cdd10a16d0303c35da7: 2023-07-11 17:54:59,501 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1689098094325.0b68e8a6a3555cdd10a16d0303c35da7. 2023-07-11 17:54:59,501 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-07-11 17:54:59,501 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-07-11 17:54:59,501 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:59,501 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-07-11 17:54:59,501 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-07-11 17:54:59,503 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:59,503 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-07-11 17:54:59,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:59,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:54:59,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:54:59,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:54:59,503 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-07-11 17:54:59,504 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 17:54:59,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:54:59,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-07-11 17:54:59,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:59,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:54:59,505 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-07-11 17:54:59,505 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7ec2b7c8[Count = 0] remaining members to acquire global barrier 2023-07-11 17:54:59,505 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-07-11 17:54:59,505 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-07-11 17:54:59,506 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-07-11 17:54:59,506 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-07-11 17:54:59,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-07-11 17:54:59,506 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-07-11 17:54:59,506 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-07-11 17:54:59,506 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:59,506 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 17:54:59,506 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase9.apache.org,45839,1689097999112' in zk 2023-07-11 17:54:59,508 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-07-11 17:54:59,508 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:59,508 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:54:59,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:59,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:54:59,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:54:59,509 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-07-11 17:54:59,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:54:59,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:54:59,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-07-11 17:54:59,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:59,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:54:59,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-07-11 17:54:59,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:59,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase9.apache.org,45839,1689097999112': 2023-07-11 17:54:59,511 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-07-11 17:54:59,511 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-07-11 17:54:59,511 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 17:54:59,511 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 17:54:59,511 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-07-11 17:54:59,511 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 17:54:59,512 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-07-11 17:54:59,512 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-07-11 17:54:59,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-07-11 17:54:59,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:54:59,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:54:59,512 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-07-11 17:54:59,512 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:54:59,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-07-11 17:54:59,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:54:59,513 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:59,513 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:54:59,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:54:59,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-07-11 17:54:59,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-07-11 17:54:59,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:54:59,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-07-11 17:54:59,514 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:59,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:59,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:54:59,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-07-11 17:54:59,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:59,516 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:59,516 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-07-11 17:54:59,516 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-07-11 17:54:59,516 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:59,516 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-07-11 17:54:59,516 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:54:59,516 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-07-11 17:54:59,516 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:54:59,516 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-07-11 17:54:59,516 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:54:59,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:54:59,516 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-07-11 17:54:59,516 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 17:54:59,516 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-07-11 17:54:59,516 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:54:59,517 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:54:59,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:54:59,517 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-07-11 17:54:59,517 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 17:54:59,542 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-07-11 17:54:59,617 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 17:54:59,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 17:54:59,619 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1689098094325.0b68e8a6a3555cdd10a16d0303c35da7. with WAL disabled. Data may be lost in the event of a crash. 2023-07-11 17:54:59,619 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1689098094325.c13bb432df8709c95734bd08b015997b. with WAL disabled. Data may be lost in the event of a crash. 2023-07-11 17:54:59,619 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1689098094325.17aacf583da279539e944e5353cb4f95. with WAL disabled. Data may be lost in the event of a crash. 2023-07-11 17:54:59,622 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 17:54:59,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-07-11 17:54:59,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-07-11 17:54:59,624 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-07-11 17:54:59,624 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:54:59,624 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-07-11 17:54:59,624 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-07-11 17:54:59,624 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-07-11 17:54:59,624 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-07-11 17:54:59,625 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:59,625 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:54:59,625 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:54:59,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:54:59,626 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:54:59,626 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 17:54:59,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-07-11 17:54:59,626 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-07-11 17:54:59,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 17:54:59,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-07-11 17:54:59,626 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-07-11 17:54:59,627 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-07-11 17:54:59,627 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-07-11 17:54:59,627 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-07-11 17:54:59,627 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:54:59,627 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-07-11 17:54:59,627 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1689098094325.17aacf583da279539e944e5353cb4f95. 2023-07-11 17:54:59,627 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1689098094325.17aacf583da279539e944e5353cb4f95. started... 2023-07-11 17:54:59,627 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1689098094325.c13bb432df8709c95734bd08b015997b. 2023-07-11 17:54:59,627 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1689098094325.c13bb432df8709c95734bd08b015997b. started... 2023-07-11 17:54:59,627 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-07-11 17:54:59,627 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 17:54:59,627 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing c13bb432df8709c95734bd08b015997b 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-07-11 17:54:59,627 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1689098094325.0b68e8a6a3555cdd10a16d0303c35da7. 2023-07-11 17:54:59,627 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 17aacf583da279539e944e5353cb4f95 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-07-11 17:54:59,627 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1689098094325.0b68e8a6a3555cdd10a16d0303c35da7. started... 2023-07-11 17:54:59,628 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 0b68e8a6a3555cdd10a16d0303c35da7 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-07-11 17:54:59,647 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023071186b920a80822440fa11dc71ce5c2eda1 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023071186b920a80822440fa11dc71ce5c2eda1 2023-07-11 17:55:00,039 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307111c8fb68fb458472e86510c786c76ca18 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202307111c8fb68fb458472e86510c786c76ca18 2023-07-11 17:55:00,043 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230711c742cd6d9dd143229322deefe82e089f to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230711c742cd6d9dd143229322deefe82e089f 2023-07-11 17:55:00,045 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/.tmp/family1/2ae88bcf87d84d07aad6592c3af1a04d 2023-07-11 17:55:00,052 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/.tmp/family1/c3c64e60ba094d8eb876fc9b98feec64 2023-07-11 17:55:00,065 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023071130fd92b9b5924bb1aa9121dace8606f7 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023071130fd92b9b5924bb1aa9121dace8606f7 2023-07-11 17:55:00,448 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/.tmp/family1/81e1f065bb5d4f5c8f55b71da3938881 2023-07-11 17:55:00,460 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307111ca3d631751b4c619c804a49c0570166 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202307111ca3d631751b4c619c804a49c0570166 2023-07-11 17:55:00,470 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/.tmp/family2/4adc47622f2a4637b3b54cce04c04b6e 2023-07-11 17:55:00,474 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/.tmp/family1/c3c64e60ba094d8eb876fc9b98feec64 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family1/c3c64e60ba094d8eb876fc9b98feec64 2023-07-11 17:55:00,478 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family1/c3c64e60ba094d8eb876fc9b98feec64, entries=4, sequenceid=13, filesize=5.4 K 2023-07-11 17:55:00,479 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/.tmp/family2/4adc47622f2a4637b3b54cce04c04b6e as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family2/4adc47622f2a4637b3b54cce04c04b6e 2023-07-11 17:55:00,483 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family2/4adc47622f2a4637b3b54cce04c04b6e, entries=2, sequenceid=13, filesize=5.1 K 2023-07-11 17:55:00,484 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 17aacf583da279539e944e5353cb4f95 in 857ms, sequenceid=13, compaction requested=true 2023-07-11 17:55:00,484 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 17aacf583da279539e944e5353cb4f95: 2023-07-11 17:55:00,484 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1689098094325.17aacf583da279539e944e5353cb4f95. 2023-07-11 17:55:00,484 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-07-11 17:55:00,863 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023071167d0fee6dc3744318ef79a76b46e637f to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023071167d0fee6dc3744318ef79a76b46e637f 2023-07-11 17:55:00,865 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/.tmp/family2/f947d88b4b43450ea6febcd27f599a5b 2023-07-11 17:55:00,872 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/.tmp/family1/2ae88bcf87d84d07aad6592c3af1a04d as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family1/2ae88bcf87d84d07aad6592c3af1a04d 2023-07-11 17:55:00,877 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/.tmp/family2/4fd592c4b4f8466e88ff4f127c71d5ef 2023-07-11 17:55:00,877 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family1/2ae88bcf87d84d07aad6592c3af1a04d, entries=4, sequenceid=13, filesize=5.4 K 2023-07-11 17:55:00,878 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/.tmp/family2/f947d88b4b43450ea6febcd27f599a5b as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family2/f947d88b4b43450ea6febcd27f599a5b 2023-07-11 17:55:00,883 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/.tmp/family1/81e1f065bb5d4f5c8f55b71da3938881 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family1/81e1f065bb5d4f5c8f55b71da3938881 2023-07-11 17:55:00,884 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family2/f947d88b4b43450ea6febcd27f599a5b, entries=2, sequenceid=13, filesize=5.1 K 2023-07-11 17:55:00,885 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 0b68e8a6a3555cdd10a16d0303c35da7 in 1258ms, sequenceid=13, compaction requested=true 2023-07-11 17:55:00,885 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 0b68e8a6a3555cdd10a16d0303c35da7: 2023-07-11 17:55:00,885 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1689098094325.0b68e8a6a3555cdd10a16d0303c35da7. 2023-07-11 17:55:00,885 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-07-11 17:55:00,887 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family1/81e1f065bb5d4f5c8f55b71da3938881, entries=4, sequenceid=13, filesize=5.4 K 2023-07-11 17:55:00,887 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/.tmp/family2/4fd592c4b4f8466e88ff4f127c71d5ef as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family2/4fd592c4b4f8466e88ff4f127c71d5ef 2023-07-11 17:55:00,895 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family2/4fd592c4b4f8466e88ff4f127c71d5ef, entries=2, sequenceid=13, filesize=5.1 K 2023-07-11 17:55:00,895 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for c13bb432df8709c95734bd08b015997b in 1268ms, sequenceid=13, compaction requested=true 2023-07-11 17:55:00,895 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for c13bb432df8709c95734bd08b015997b: 2023-07-11 17:55:00,896 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1689098094325.c13bb432df8709c95734bd08b015997b. 2023-07-11 17:55:00,896 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-07-11 17:55:00,896 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-07-11 17:55:00,896 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:00,896 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-07-11 17:55:00,896 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-07-11 17:55:00,898 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:00,898 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-07-11 17:55:00,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:00,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:55:00,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:55:00,898 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-07-11 17:55:00,898 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 17:55:00,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:55:00,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:55:00,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-07-11 17:55:00,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:00,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:55:00,899 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-07-11 17:55:00,899 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@23fc0b01[Count = 0] remaining members to acquire global barrier 2023-07-11 17:55:00,899 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-07-11 17:55:00,900 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-07-11 17:55:00,901 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-07-11 17:55:00,901 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-07-11 17:55:00,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-07-11 17:55:00,901 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-07-11 17:55:00,901 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-07-11 17:55:00,901 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase9.apache.org,45839,1689097999112' in zk 2023-07-11 17:55:00,901 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:00,901 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 17:55:00,902 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-07-11 17:55:00,902 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:55:00,902 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:00,902 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-07-11 17:55:00,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:00,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:55:00,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:55:00,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:55:00,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:55:00,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-07-11 17:55:00,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:00,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:55:00,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-07-11 17:55:00,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:00,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase9.apache.org,45839,1689097999112': 2023-07-11 17:55:00,905 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-07-11 17:55:00,905 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-07-11 17:55:00,905 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 17:55:00,905 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 17:55:00,905 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-07-11 17:55:00,905 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 17:55:00,914 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-07-11 17:55:00,915 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-07-11 17:55:00,915 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-07-11 17:55:00,915 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:55:00,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-07-11 17:55:00,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-07-11 17:55:00,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:55:00,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:55:00,915 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:55:00,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:55:00,915 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:00,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:55:00,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-07-11 17:55:00,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-07-11 17:55:00,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:55:00,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-07-11 17:55:00,916 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:00,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:00,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:55:00,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-07-11 17:55:00,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:00,918 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:00,918 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:55:00,918 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:55:00,918 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-07-11 17:55:00,918 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:55:00,918 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-07-11 17:55:00,918 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:55:00,918 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-07-11 17:55:00,918 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 17:55:00,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:55:00,918 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:00,918 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-07-11 17:55:00,918 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-07-11 17:55:00,919 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-07-11 17:55:00,919 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-07-11 17:55:00,919 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:55:00,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:55:00,919 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-07-11 17:55:00,919 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 17:55:01,019 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 17:55:01,020 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 17:55:01,021 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1689098094325.0b68e8a6a3555cdd10a16d0303c35da7. with WAL disabled. Data may be lost in the event of a crash. 2023-07-11 17:55:01,021 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1689098094325.c13bb432df8709c95734bd08b015997b. with WAL disabled. Data may be lost in the event of a crash. 2023-07-11 17:55:01,022 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1689098094325.17aacf583da279539e944e5353cb4f95. with WAL disabled. Data may be lost in the event of a crash. 2023-07-11 17:55:01,024 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 17:55:01,026 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-07-11 17:55:01,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-07-11 17:55:01,027 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-07-11 17:55:01,027 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:55:01,027 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-07-11 17:55:01,027 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-07-11 17:55:01,027 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-07-11 17:55:01,027 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-07-11 17:55:01,029 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:55:01,029 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:01,029 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:55:01,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:55:01,029 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:01,029 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 17:55:01,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-07-11 17:55:01,030 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-07-11 17:55:01,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 17:55:01,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-07-11 17:55:01,030 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-07-11 17:55:01,030 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-07-11 17:55:01,030 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-07-11 17:55:01,030 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-07-11 17:55:01,031 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:55:01,031 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-07-11 17:55:01,034 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1689098094325.17aacf583da279539e944e5353cb4f95. 2023-07-11 17:55:01,034 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1689098094325.17aacf583da279539e944e5353cb4f95. started... 2023-07-11 17:55:01,034 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 17aacf583da279539e944e5353cb4f95 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-07-11 17:55:01,036 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1689098094325.c13bb432df8709c95734bd08b015997b. 2023-07-11 17:55:01,036 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-07-11 17:55:01,036 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 17:55:01,036 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1689098094325.0b68e8a6a3555cdd10a16d0303c35da7. 2023-07-11 17:55:01,036 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1689098094325.0b68e8a6a3555cdd10a16d0303c35da7. started... 2023-07-11 17:55:01,036 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1689098094325.c13bb432df8709c95734bd08b015997b. started... 2023-07-11 17:55:01,036 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 0b68e8a6a3555cdd10a16d0303c35da7 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-07-11 17:55:01,037 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing c13bb432df8709c95734bd08b015997b 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-07-11 17:55:01,067 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230711b9209a6f661046c2bbf3ce8c223e422e to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230711b9209a6f661046c2bbf3ce8c223e422e 2023-07-11 17:55:01,073 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023071143ec884407d94c27940dfd59e222e6b1 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023071143ec884407d94c27940dfd59e222e6b1 2023-07-11 17:55:01,082 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230711424207b9ba6e4a258b0a8ebee407947b to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230711424207b9ba6e4a258b0a8ebee407947b 2023-07-11 17:55:01,108 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/.tmp/family1/4a50c361db254e91bf01d52a3e927bcd 2023-07-11 17:55:01,147 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202307114d4befb1d9ec488aa7c800b754123635 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202307114d4befb1d9ec488aa7c800b754123635 2023-07-11 17:55:01,154 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/.tmp/family2/26f71c895e82431b9c24d88865e336be 2023-07-11 17:55:01,158 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/.tmp/family1/4a50c361db254e91bf01d52a3e927bcd as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family1/4a50c361db254e91bf01d52a3e927bcd 2023-07-11 17:55:01,162 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family1/4a50c361db254e91bf01d52a3e927bcd, entries=4, sequenceid=17, filesize=5.4 K 2023-07-11 17:55:01,163 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/.tmp/family2/26f71c895e82431b9c24d88865e336be as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family2/26f71c895e82431b9c24d88865e336be 2023-07-11 17:55:01,167 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family2/26f71c895e82431b9c24d88865e336be, entries=2, sequenceid=17, filesize=5.1 K 2023-07-11 17:55:01,168 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for c13bb432df8709c95734bd08b015997b in 132ms, sequenceid=17, compaction requested=true 2023-07-11 17:55:01,168 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for c13bb432df8709c95734bd08b015997b: 2023-07-11 17:55:01,168 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1689098094325.c13bb432df8709c95734bd08b015997b. 2023-07-11 17:55:01,168 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-07-11 17:55:01,490 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/.tmp/family1/573c26d7757245d6943f5d881e9bc774 2023-07-11 17:55:01,492 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/.tmp/family1/f9f5f943383c4935bf464d264c2e9f15 2023-07-11 17:55:01,523 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202307117652c7165c3c40febc8cf20a22084b70 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202307117652c7165c3c40febc8cf20a22084b70 2023-07-11 17:55:01,921 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230711bc062d43f212492faf7a4f044f1c79bd to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230711bc062d43f212492faf7a4f044f1c79bd 2023-07-11 17:55:01,927 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/.tmp/family2/92122c7c52a6480298263dfb61d0b114 2023-07-11 17:55:01,928 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/.tmp/family2/ebe0cbb7380846508944493a19164584 2023-07-11 17:55:01,931 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/.tmp/family1/573c26d7757245d6943f5d881e9bc774 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family1/573c26d7757245d6943f5d881e9bc774 2023-07-11 17:55:01,933 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/.tmp/family1/f9f5f943383c4935bf464d264c2e9f15 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family1/f9f5f943383c4935bf464d264c2e9f15 2023-07-11 17:55:01,936 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family1/573c26d7757245d6943f5d881e9bc774, entries=4, sequenceid=17, filesize=5.4 K 2023-07-11 17:55:01,937 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/.tmp/family2/92122c7c52a6480298263dfb61d0b114 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family2/92122c7c52a6480298263dfb61d0b114 2023-07-11 17:55:01,939 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family1/f9f5f943383c4935bf464d264c2e9f15, entries=4, sequenceid=17, filesize=5.4 K 2023-07-11 17:55:01,940 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/.tmp/family2/ebe0cbb7380846508944493a19164584 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family2/ebe0cbb7380846508944493a19164584 2023-07-11 17:55:01,942 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family2/92122c7c52a6480298263dfb61d0b114, entries=2, sequenceid=17, filesize=5.1 K 2023-07-11 17:55:01,944 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family2/ebe0cbb7380846508944493a19164584, entries=2, sequenceid=17, filesize=5.1 K 2023-07-11 17:55:01,949 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 17aacf583da279539e944e5353cb4f95 in 915ms, sequenceid=17, compaction requested=true 2023-07-11 17:55:01,949 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 0b68e8a6a3555cdd10a16d0303c35da7 in 913ms, sequenceid=17, compaction requested=true 2023-07-11 17:55:01,949 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 17aacf583da279539e944e5353cb4f95: 2023-07-11 17:55:01,949 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 0b68e8a6a3555cdd10a16d0303c35da7: 2023-07-11 17:55:01,949 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1689098094325.17aacf583da279539e944e5353cb4f95. 2023-07-11 17:55:01,949 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1689098094325.0b68e8a6a3555cdd10a16d0303c35da7. 2023-07-11 17:55:01,949 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-07-11 17:55:01,949 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-07-11 17:55:01,949 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-07-11 17:55:01,949 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:01,949 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-07-11 17:55:01,949 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-07-11 17:55:01,951 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:01,951 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-07-11 17:55:01,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:01,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:55:01,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:55:01,951 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-07-11 17:55:01,952 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 17:55:01,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:55:01,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:55:01,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-07-11 17:55:01,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:01,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:55:01,953 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-07-11 17:55:01,953 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@702051c3[Count = 0] remaining members to acquire global barrier 2023-07-11 17:55:01,953 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-07-11 17:55:01,953 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-07-11 17:55:01,955 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-07-11 17:55:01,955 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-07-11 17:55:01,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-07-11 17:55:01,955 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-07-11 17:55:01,955 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-07-11 17:55:01,955 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase9.apache.org,45839,1689097999112' in zk 2023-07-11 17:55:01,956 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:01,956 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 17:55:01,957 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:01,957 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-07-11 17:55:01,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:01,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:55:01,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:55:01,957 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:55:01,957 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-07-11 17:55:01,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:55:01,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:55:01,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-07-11 17:55:01,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:01,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:55:01,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-07-11 17:55:01,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:01,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase9.apache.org,45839,1689097999112': 2023-07-11 17:55:01,960 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-07-11 17:55:01,960 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 17:55:01,960 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 17:55:01,960 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-07-11 17:55:01,960 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-07-11 17:55:01,960 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 17:55:01,961 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-07-11 17:55:01,961 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-07-11 17:55:01,961 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-07-11 17:55:01,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-07-11 17:55:01,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:55:01,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:55:01,961 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:55:01,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-07-11 17:55:01,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:55:01,962 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:01,962 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:55:01,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:55:01,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-07-11 17:55:01,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-07-11 17:55:01,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:55:01,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-07-11 17:55:01,963 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:01,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:01,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:55:01,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-07-11 17:55:01,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:01,966 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:01,966 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:55:01,966 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-07-11 17:55:01,966 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:55:01,966 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-07-11 17:55:01,966 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:01,966 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-07-11 17:55:01,966 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 17:55:01,966 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:55:01,966 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-07-11 17:55:01,966 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-07-11 17:55:01,966 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-07-11 17:55:01,966 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:55:01,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:55:01,966 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-07-11 17:55:01,966 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 17:55:01,966 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-07-11 17:55:01,967 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:55:01,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:55:02,067 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 17:55:02,068 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 17:55:02,081 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=snaptb-1689098102068 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-07-11 17:55:02,082 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689098102082 (current time:1689098102082). 2023-07-11 17:55:02,082 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-11 17:55:02,082 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] zookeeper.ReadOnlyZKClient(139): Connect 0x7b6f257e to 127.0.0.1:50702 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 17:55:02,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6cf7b8ec, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 17:55:02,095 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 17:55:02,098 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:49730, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 17:55:02,099 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7b6f257e to 127.0.0.1:50702 2023-07-11 17:55:02,099 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 17:55:02,099 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-11 17:55:02,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb-1689098102068 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-07-11 17:55:02,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure2.ProcedureExecutor(1029): Stored pid=86, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-07-11 17:55:02,115 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=86, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-07-11 17:55:02,116 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=86, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE; timeout=600000, timestamp=1689098702116 2023-07-11 17:55:02,117 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb-1689098102068 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-07-11 17:55:02,118 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb-1689098102068 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink 2023-07-11 17:55:02,119 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=86, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-07-11 17:55:02,120 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=87, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-07-11 17:55:02,120 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=86, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE in 5 msec 2023-07-11 17:55:02,121 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=87, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-07-11 17:55:02,122 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=87, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED; timeout=600000, timestamp=1689098702122 2023-07-11 17:55:02,124 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb-1689098102068 table=testCompactionWithHFileLink type=FLUSH ttl=0 }'' to complete. (max 300000 ms per retry) 2023-07-11 17:55:02,124 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-11 17:55:02,133 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb-1689098102068 2023-07-11 17:55:02,137 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb-1689098102068' 2023-07-11 17:55:02,137 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 17:55:02,137 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb-1689098102068' starting 'acquire' 2023-07-11 17:55:02,137 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb-1689098102068', kicking off acquire phase on members. 2023-07-11 17:55:02,137 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb-1689098102068 2023-07-11 17:55:02,137 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb-1689098102068 2023-07-11 17:55:02,138 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 17:55:02,138 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb-1689098102068/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:02,139 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 17:55:02,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 17:55:02,139 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb-1689098102068/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:02,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb-1689098102068 2023-07-11 17:55:02,139 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 17:55:02,139 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb-1689098102068 2023-07-11 17:55:02,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-07-11 17:55:02,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb-1689098102068 2023-07-11 17:55:02,140 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb-1689098102068 from table testCompactionWithHFileLink type FLUSH 2023-07-11 17:55:02,142 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb-1689098102068 2023-07-11 17:55:02,143 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb-1689098102068' with timeout 300000ms 2023-07-11 17:55:02,143 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 17:55:02,143 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb-1689098102068' starting 'acquire' stage 2023-07-11 17:55:02,143 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb-1689098102068' locally acquired 2023-07-11 17:55:02,143 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure (snaptb-1689098102068) in zk 2023-07-11 17:55:02,144 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb-1689098102068 2023-07-11 17:55:02,144 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1689098102068/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:02,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb-1689098102068/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:02,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:55:02,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 17:55:02,145 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb-1689098102068 2023-07-11 17:55:02,145 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb-1689098102068' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 17:55:02,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:55:02,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:55:02,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1689098102068 2023-07-11 17:55:02,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:02,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:55:02,147 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure 'snaptb-1689098102068' on coordinator 2023-07-11 17:55:02,147 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@39499ae7[Count = 0] remaining members to acquire global barrier 2023-07-11 17:55:02,147 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb-1689098102068' starting 'in-barrier' execution. 2023-07-11 17:55:02,147 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb-1689098102068 2023-07-11 17:55:02,149 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1689098102068 2023-07-11 17:55:02,149 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb-1689098102068 2023-07-11 17:55:02,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb-1689098102068 2023-07-11 17:55:02,149 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb-1689098102068' received 'reached' from coordinator. 2023-07-11 17:55:02,149 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb-1689098102068/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:02,149 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 17:55:02,150 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,2,1689098094325.17aacf583da279539e944e5353cb4f95. 2023-07-11 17:55:02,150 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,1,1689098094325.c13bb432df8709c95734bd08b015997b. 2023-07-11 17:55:02,151 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,1,1689098094325.c13bb432df8709c95734bd08b015997b. started... 2023-07-11 17:55:02,151 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,2,1689098094325.17aacf583da279539e944e5353cb4f95. started... 2023-07-11 17:55:02,151 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-snapshot-pool-1] regionserver.HRegion(2446): Flush status journal for c13bb432df8709c95734bd08b015997b: 2023-07-11 17:55:02,151 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 17aacf583da279539e944e5353cb4f95: 2023-07-11 17:55:02,152 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,1,1689098094325.c13bb432df8709c95734bd08b015997b.' region-info for snapshot=snaptb-1689098102068 2023-07-11 17:55:02,152 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,2,1689098094325.17aacf583da279539e944e5353cb4f95.' region-info for snapshot=snaptb-1689098102068 2023-07-11 17:55:02,153 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 3 regions 2023-07-11 17:55:02,153 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,,1689098094325.0b68e8a6a3555cdd10a16d0303c35da7. 2023-07-11 17:55:02,153 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-11 17:55:02,154 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,,1689098094325.0b68e8a6a3555cdd10a16d0303c35da7. started... 2023-07-11 17:55:02,154 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-snapshot-pool-2] regionserver.HRegion(2446): Flush status journal for 0b68e8a6a3555cdd10a16d0303c35da7: 2023-07-11 17:55:02,154 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,,1689098094325.0b68e8a6a3555cdd10a16d0303c35da7.' region-info for snapshot=snaptb-1689098102068 2023-07-11 17:55:02,157 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-11 17:55:02,157 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-11 17:55:02,157 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-11 17:55:02,161 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family1/76b71e8b082a4db9a277c10783c7028f, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family1/30f4c31959d44a41b966543ef2a39e52, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family1/81e1f065bb5d4f5c8f55b71da3938881, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family1/4a50c361db254e91bf01d52a3e927bcd] hfiles 2023-07-11 17:55:02,161 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family1/5a91189cc1db4a21b3f357d74add3143, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family1/e23b0c73b533452b95b0ad7a117cc636, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family1/c3c64e60ba094d8eb876fc9b98feec64, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family1/f9f5f943383c4935bf464d264c2e9f15] hfiles 2023-07-11 17:55:02,161 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family1/76b71e8b082a4db9a277c10783c7028f for snapshot=snaptb-1689098102068 2023-07-11 17:55:02,161 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family1/a707ff33e39949af81987160f0ba5530, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family1/ba7bb4ba5b4b4f56bf5eb50df7f9ec97, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family1/2ae88bcf87d84d07aad6592c3af1a04d, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family1/573c26d7757245d6943f5d881e9bc774] hfiles 2023-07-11 17:55:02,161 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family1/5a91189cc1db4a21b3f357d74add3143 for snapshot=snaptb-1689098102068 2023-07-11 17:55:02,161 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family1/a707ff33e39949af81987160f0ba5530 for snapshot=snaptb-1689098102068 2023-07-11 17:55:02,335 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 17:55:02,335 INFO [regionserver/jenkins-hbase9:0.Chore.1] hbase.ScheduledChore(142): Chore: CompactedHFilesCleaner missed its start time 2023-07-11 17:55:02,335 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x52478fa0 to 127.0.0.1:50702 2023-07-11 17:55:02,337 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 17:55:02,337 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-11 17:55:02,338 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0423b889 to 127.0.0.1:50702 2023-07-11 17:55:02,338 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 17:55:02,338 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6b3cf84f to 127.0.0.1:50702 2023-07-11 17:55:02,338 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 17:55:02,338 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-11 17:55:02,338 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x789f1321 to 127.0.0.1:50702 2023-07-11 17:55:02,338 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 17:55:02,338 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-11 17:55:02,338 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x79071bf3 to 127.0.0.1:50702 2023-07-11 17:55:02,338 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 17:55:02,339 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-11 17:55:02,339 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x673da8c6 to 127.0.0.1:50702 2023-07-11 17:55:02,339 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 17:55:02,340 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family1/e23b0c73b533452b95b0ad7a117cc636 for snapshot=snaptb-1689098102068 2023-07-11 17:55:02,341 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family1/c3c64e60ba094d8eb876fc9b98feec64 for snapshot=snaptb-1689098102068 2023-07-11 17:55:02,341 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family1/f9f5f943383c4935bf464d264c2e9f15 for snapshot=snaptb-1689098102068 2023-07-11 17:55:02,341 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1689098102068 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-07-11 17:55:02,341 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family2/93d53e1b8309484aa3e0289e23d040ab, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family2/cccfc7c128044a978c31c85a74c6959a, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family2/4adc47622f2a4637b3b54cce04c04b6e, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family2/ebe0cbb7380846508944493a19164584] hfiles 2023-07-11 17:55:02,341 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family2/93d53e1b8309484aa3e0289e23d040ab for snapshot=snaptb-1689098102068 2023-07-11 17:55:02,341 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family2/cccfc7c128044a978c31c85a74c6959a for snapshot=snaptb-1689098102068 2023-07-11 17:55:02,341 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family2/4adc47622f2a4637b3b54cce04c04b6e for snapshot=snaptb-1689098102068 2023-07-11 17:55:02,341 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family2/ebe0cbb7380846508944493a19164584 for snapshot=snaptb-1689098102068 2023-07-11 17:55:02,340 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family1/30f4c31959d44a41b966543ef2a39e52 for snapshot=snaptb-1689098102068 2023-07-11 17:55:02,340 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family1/ba7bb4ba5b4b4f56bf5eb50df7f9ec97 for snapshot=snaptb-1689098102068 2023-07-11 17:55:02,342 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family1/81e1f065bb5d4f5c8f55b71da3938881 for snapshot=snaptb-1689098102068 2023-07-11 17:55:02,342 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family1/4a50c361db254e91bf01d52a3e927bcd for snapshot=snaptb-1689098102068 2023-07-11 17:55:02,342 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family2/02c2a20c070443429b770182c7743f19, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family2/53a30bd9c0034d4184a04d4074cea82d, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family2/4fd592c4b4f8466e88ff4f127c71d5ef, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family2/26f71c895e82431b9c24d88865e336be] hfiles 2023-07-11 17:55:02,342 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family2/02c2a20c070443429b770182c7743f19 for snapshot=snaptb-1689098102068 2023-07-11 17:55:02,342 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family2/53a30bd9c0034d4184a04d4074cea82d for snapshot=snaptb-1689098102068 2023-07-11 17:55:02,342 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family2/4fd592c4b4f8466e88ff4f127c71d5ef for snapshot=snaptb-1689098102068 2023-07-11 17:55:02,342 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family2/26f71c895e82431b9c24d88865e336be for snapshot=snaptb-1689098102068 2023-07-11 17:55:02,342 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family1/2ae88bcf87d84d07aad6592c3af1a04d for snapshot=snaptb-1689098102068 2023-07-11 17:55:02,342 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family1/573c26d7757245d6943f5d881e9bc774 for snapshot=snaptb-1689098102068 2023-07-11 17:55:02,342 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family2/1f1fcd346abe4a0d82bc870270831a57, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family2/2039c633aed54fb586721637ea9d9e6a, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family2/f947d88b4b43450ea6febcd27f599a5b, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family2/92122c7c52a6480298263dfb61d0b114] hfiles 2023-07-11 17:55:02,342 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family2/1f1fcd346abe4a0d82bc870270831a57 for snapshot=snaptb-1689098102068 2023-07-11 17:55:02,342 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family2/2039c633aed54fb586721637ea9d9e6a for snapshot=snaptb-1689098102068 2023-07-11 17:55:02,342 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family2/f947d88b4b43450ea6febcd27f599a5b for snapshot=snaptb-1689098102068 2023-07-11 17:55:02,342 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family2/92122c7c52a6480298263dfb61d0b114 for snapshot=snaptb-1689098102068 2023-07-11 17:55:02,343 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1689098102068 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-07-11 17:55:02,343 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-11 17:55:02,543 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 17:55:02,544 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1689098102068 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-07-11 17:55:02,544 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1689098102068 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-07-11 17:55:02,544 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-11 17:55:02,755 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,1,1689098094325.c13bb432df8709c95734bd08b015997b. completed. 2023-07-11 17:55:02,755 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,1,1689098094325.c13bb432df8709c95734bd08b015997b. 2023-07-11 17:55:02,756 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/3 local region snapshots. 2023-07-11 17:55:02,759 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,2,1689098094325.17aacf583da279539e944e5353cb4f95. completed. 2023-07-11 17:55:02,759 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,2,1689098094325.17aacf583da279539e944e5353cb4f95. 2023-07-11 17:55:02,759 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/3 local region snapshots. 2023-07-11 17:55:02,760 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,,1689098094325.0b68e8a6a3555cdd10a16d0303c35da7. completed. 2023-07-11 17:55:02,760 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,,1689098094325.0b68e8a6a3555cdd10a16d0303c35da7. 2023-07-11 17:55:02,760 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/3 local region snapshots. 2023-07-11 17:55:02,760 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 3 local region snapshots. 2023-07-11 17:55:02,760 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:02,760 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb-1689098102068' locally completed 2023-07-11 17:55:02,760 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb-1689098102068' completed for member 'jenkins-hbase9.apache.org,45839,1689097999112' in zk 2023-07-11 17:55:02,763 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1689098102068/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:02,763 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb-1689098102068' has notified controller of completion 2023-07-11 17:55:02,763 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:55:02,763 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb-1689098102068' completed. 2023-07-11 17:55:02,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb-1689098102068/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:02,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:55:02,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 17:55:02,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:55:02,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:55:02,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1689098102068 2023-07-11 17:55:02,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:02,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:55:02,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1689098102068 2023-07-11 17:55:02,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:02,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb-1689098102068' member 'jenkins-hbase9.apache.org,45839,1689097999112': 2023-07-11 17:55:02,767 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' released barrier for procedure'snaptb-1689098102068', counting down latch. Waiting for 0 more 2023-07-11 17:55:02,767 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb-1689098102068' execution completed 2023-07-11 17:55:02,767 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 17:55:02,767 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 17:55:02,767 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb-1689098102068 2023-07-11 17:55:02,767 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb-1689098102068including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-11 17:55:02,769 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1689098102068 2023-07-11 17:55:02,769 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1689098102068 2023-07-11 17:55:02,769 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb-1689098102068 2023-07-11 17:55:02,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb-1689098102068 2023-07-11 17:55:02,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:55:02,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 17:55:02,769 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 17:55:02,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb-1689098102068 2023-07-11 17:55:02,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:55:02,770 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 17:55:02,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 17:55:02,770 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb-1689098102068/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:02,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1689098102068 2023-07-11 17:55:02,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb-1689098102068 2023-07-11 17:55:02,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:55:02,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1689098102068 2023-07-11 17:55:02,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:02,772 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb-1689098102068/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:02,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:55:02,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1689098102068 2023-07-11 17:55:02,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:02,781 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1689098102068/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:02,781 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1689098102068 2023-07-11 17:55:02,781 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1689098102068 2023-07-11 17:55:02,781 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1689098102068/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:02,781 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 17:55:02,781 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb-1689098102068 2023-07-11 17:55:02,781 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1689098102068 2023-07-11 17:55:02,781 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:55:02,781 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testCompactionWithHFileLink 2023-07-11 17:55:02,781 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1689098102068 2023-07-11 17:55:02,781 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 17:55:02,781 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 17:55:02,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 17:55:02,782 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 0e7b6fa9e81bd62588edd7d77d6165e4, NAME => 'testCompactionWithHFileLink,.mob,0.0e7b6fa9e81bd62588edd7d77d6165e4.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb-1689098102068 2023-07-11 17:55:02,782 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1689098102068 2023-07-11 17:55:02,782 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-11 17:55:02,782 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 17:55:02,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 17:55:02,784 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230711424207b9ba6e4a258b0a8ebee407947b, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023071159eb6543927c4caebe900be67b0dc8b1, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230711c742cd6d9dd143229322deefe82e089f, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230711d34c31dca08a4a3d87c90aae83c14ab8, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023071143ec884407d94c27940dfd59e222e6b1, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230711677457bc24104b5390bb726bdfdde12d, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023071186b920a80822440fa11dc71ce5c2eda1, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230711aa14f34b4f9540efbcae4d44c4a026cb, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202307111c8fb68fb458472e86510c786c76ca18, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023071191aac97fa1dc4c54a45b2652468490a8, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230711b9209a6f661046c2bbf3ce8c223e422e, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230711dfdabf355e284e7791a42e28492c6e4b] mob files 2023-07-11 17:55:02,784 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/12): hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230711424207b9ba6e4a258b0a8ebee407947b 2023-07-11 17:55:02,784 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/12): hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023071159eb6543927c4caebe900be67b0dc8b1 2023-07-11 17:55:02,784 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (3/12): hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230711c742cd6d9dd143229322deefe82e089f 2023-07-11 17:55:02,784 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (4/12): hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230711d34c31dca08a4a3d87c90aae83c14ab8 2023-07-11 17:55:02,784 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (5/12): hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023071143ec884407d94c27940dfd59e222e6b1 2023-07-11 17:55:02,784 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (6/12): hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230711677457bc24104b5390bb726bdfdde12d 2023-07-11 17:55:02,784 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (7/12): hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023071186b920a80822440fa11dc71ce5c2eda1 2023-07-11 17:55:02,784 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (8/12): hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230711aa14f34b4f9540efbcae4d44c4a026cb 2023-07-11 17:55:02,784 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (9/12): hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202307111c8fb68fb458472e86510c786c76ca18 2023-07-11 17:55:02,784 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (10/12): hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023071191aac97fa1dc4c54a45b2652468490a8 2023-07-11 17:55:02,784 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (11/12): hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230711b9209a6f661046c2bbf3ce8c223e422e 2023-07-11 17:55:02,784 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (12/12): hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230711dfdabf355e284e7791a42e28492c6e4b 2023-07-11 17:55:02,786 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202307114d4befb1d9ec488aa7c800b754123635, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023071167d0fee6dc3744318ef79a76b46e637f, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202307118776f0ea9be24e7eb92fb093d0386232, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230711f0df82d81bef489ebc1436d7e4ad3d67, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023071130fd92b9b5924bb1aa9121dace8606f7, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023071151880ab39eb74fcbab8c0532f1534224, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202307117652c7165c3c40febc8cf20a22084b70, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230711bb1d4ef0cd35465f80af67cdc07f9227, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202307111ca3d631751b4c619c804a49c0570166, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230711532554084d014e04ae1f465a0b0dde54, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230711bc062d43f212492faf7a4f044f1c79bd, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230711beabf5cd3ffa43308073ccb69f996243] mob files 2023-07-11 17:55:02,786 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/12): hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202307114d4befb1d9ec488aa7c800b754123635 2023-07-11 17:55:02,786 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/12): hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023071167d0fee6dc3744318ef79a76b46e637f 2023-07-11 17:55:02,786 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (3/12): hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202307118776f0ea9be24e7eb92fb093d0386232 2023-07-11 17:55:02,786 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (4/12): hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230711f0df82d81bef489ebc1436d7e4ad3d67 2023-07-11 17:55:02,786 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (5/12): hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023071130fd92b9b5924bb1aa9121dace8606f7 2023-07-11 17:55:02,786 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (6/12): hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023071151880ab39eb74fcbab8c0532f1534224 2023-07-11 17:55:02,786 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (7/12): hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202307117652c7165c3c40febc8cf20a22084b70 2023-07-11 17:55:02,786 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (8/12): hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230711bb1d4ef0cd35465f80af67cdc07f9227 2023-07-11 17:55:02,786 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (9/12): hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202307111ca3d631751b4c619c804a49c0570166 2023-07-11 17:55:02,786 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (10/12): hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230711532554084d014e04ae1f465a0b0dde54 2023-07-11 17:55:02,787 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (11/12): hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230711bc062d43f212492faf7a4f044f1c79bd 2023-07-11 17:55:02,787 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (12/12): hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230711beabf5cd3ffa43308073ccb69f996243 2023-07-11 17:55:02,845 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 17:55:02,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1689098102068 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-07-11 17:55:02,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1689098102068 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-07-11 17:55:02,846 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-11 17:55:03,195 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb-1689098102068 2023-07-11 17:55:03,197 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/.hbase-snapshot/.tmp/snaptb-1689098102068 2023-07-11 17:55:03,346 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 17:55:03,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1689098102068 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-07-11 17:55:03,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1689098102068 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-07-11 17:55:03,347 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-07-11 17:55:03,654 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/.hbase-snapshot/.tmp/snaptb-1689098102068 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/.hbase-snapshot/snaptb-1689098102068 2023-07-11 17:55:04,081 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb-1689098102068 of table testCompactionWithHFileLink completed 2023-07-11 17:55:04,081 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/.hbase-snapshot/.tmp/snaptb-1689098102068 2023-07-11 17:55:04,081 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/.hbase-snapshot/.tmp/snaptb-1689098102068 2023-07-11 17:55:04,082 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb-1689098102068 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink at 1689098102118Completed referencing HFiles for the mob region of table: testCompactionWithHFileLink at 1689098103195 (+1077 ms)Consolidate snapshot: snaptb-1689098102068 at 1689098103195Loading Region manifests for snaptb-1689098102068 at 1689098103195Writing data manifest for snaptb-1689098102068 at 1689098103208 (+13 ms)Verifying snapshot: snaptb-1689098102068 at 1689098103619 (+411 ms)Snapshot snaptb-1689098102068 of table testCompactionWithHFileLink completed at 1689098104081 (+462 ms) 2023-07-11 17:55:04,083 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=87, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-07-11 17:55:04,085 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=87, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED in 1.9640 sec 2023-07-11 17:55:04,347 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 17:55:04,348 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1689098102068 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-07-11 17:55:04,348 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb-1689098102068 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-11 17:55:04,384 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 17:55:04,385 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-07-11 17:55:04,386 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-07-11 17:55:04,386 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-07-11 17:55:04,386 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:55:04,386 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-07-11 17:55:04,386 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-07-11 17:55:04,386 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-07-11 17:55:04,386 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-07-11 17:55:04,387 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:55:04,387 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:04,388 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:55:04,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:55:04,388 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:04,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-07-11 17:55:04,388 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 17:55:04,388 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-07-11 17:55:04,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 17:55:04,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-07-11 17:55:04,389 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-07-11 17:55:04,389 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-07-11 17:55:04,390 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-07-11 17:55:04,390 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:55:04,390 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-07-11 17:55:04,391 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1689098094325.17aacf583da279539e944e5353cb4f95. 2023-07-11 17:55:04,391 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1689098094325.17aacf583da279539e944e5353cb4f95. started... 2023-07-11 17:55:04,391 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 17aacf583da279539e944e5353cb4f95 2/2 column families, dataSize=138 B heapSize=944 B 2023-07-11 17:55:04,391 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1689098094325.c13bb432df8709c95734bd08b015997b. 2023-07-11 17:55:04,391 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1689098094325.c13bb432df8709c95734bd08b015997b. started... 2023-07-11 17:55:04,391 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing c13bb432df8709c95734bd08b015997b 2/2 column families, dataSize=138 B heapSize=944 B 2023-07-11 17:55:04,391 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-07-11 17:55:04,391 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 17:55:04,392 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1689098094325.0b68e8a6a3555cdd10a16d0303c35da7. 2023-07-11 17:55:04,392 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1689098094325.0b68e8a6a3555cdd10a16d0303c35da7. started... 2023-07-11 17:55:04,392 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 0b68e8a6a3555cdd10a16d0303c35da7 2/2 column families, dataSize=138 B heapSize=944 B 2023-07-11 17:55:04,431 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/.tmp/family1/1bc38544d7464d2ba2b6d994c0bba775 2023-07-11 17:55:04,436 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1bc38544d7464d2ba2b6d994c0bba775 2023-07-11 17:55:04,461 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/.tmp/family2/d408114b42d44cfb8acb1b55b0729681 2023-07-11 17:55:04,465 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d408114b42d44cfb8acb1b55b0729681 2023-07-11 17:55:04,466 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/.tmp/family1/1bc38544d7464d2ba2b6d994c0bba775 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family1/1bc38544d7464d2ba2b6d994c0bba775 2023-07-11 17:55:04,469 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1bc38544d7464d2ba2b6d994c0bba775 2023-07-11 17:55:04,470 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family1/1bc38544d7464d2ba2b6d994c0bba775, entries=3, sequenceid=24, filesize=5.0 K 2023-07-11 17:55:04,473 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/.tmp/family2/d408114b42d44cfb8acb1b55b0729681 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family2/d408114b42d44cfb8acb1b55b0729681 2023-07-11 17:55:04,477 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d408114b42d44cfb8acb1b55b0729681 2023-07-11 17:55:04,478 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family2/d408114b42d44cfb8acb1b55b0729681, entries=1, sequenceid=24, filesize=5.0 K 2023-07-11 17:55:04,478 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for c13bb432df8709c95734bd08b015997b in 87ms, sequenceid=24, compaction requested=true 2023-07-11 17:55:04,478 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for c13bb432df8709c95734bd08b015997b: 2023-07-11 17:55:04,478 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1689098094325.c13bb432df8709c95734bd08b015997b. 2023-07-11 17:55:04,478 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-07-11 17:55:05,230 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/.tmp/family1/b2922041196743828f005b0c59e6464d 2023-07-11 17:55:05,230 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/.tmp/family1/1c76b7c815ca4a7f89cffa4e62e9ea34 2023-07-11 17:55:05,233 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b2922041196743828f005b0c59e6464d 2023-07-11 17:55:05,234 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1c76b7c815ca4a7f89cffa4e62e9ea34 2023-07-11 17:55:06,049 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/.tmp/family2/57075e17d99b4276a56f364037e45cc9 2023-07-11 17:55:06,051 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/.tmp/family2/2ad90541d94b431caa8598854250737b 2023-07-11 17:55:06,053 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 57075e17d99b4276a56f364037e45cc9 2023-07-11 17:55:06,054 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2ad90541d94b431caa8598854250737b 2023-07-11 17:55:06,054 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/.tmp/family1/b2922041196743828f005b0c59e6464d as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family1/b2922041196743828f005b0c59e6464d 2023-07-11 17:55:06,055 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/.tmp/family1/1c76b7c815ca4a7f89cffa4e62e9ea34 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family1/1c76b7c815ca4a7f89cffa4e62e9ea34 2023-07-11 17:55:06,058 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b2922041196743828f005b0c59e6464d 2023-07-11 17:55:06,058 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family1/b2922041196743828f005b0c59e6464d, entries=3, sequenceid=24, filesize=5.0 K 2023-07-11 17:55:06,058 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1c76b7c815ca4a7f89cffa4e62e9ea34 2023-07-11 17:55:06,058 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family1/1c76b7c815ca4a7f89cffa4e62e9ea34, entries=3, sequenceid=24, filesize=5.0 K 2023-07-11 17:55:06,059 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/.tmp/family2/57075e17d99b4276a56f364037e45cc9 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family2/57075e17d99b4276a56f364037e45cc9 2023-07-11 17:55:06,059 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/.tmp/family2/2ad90541d94b431caa8598854250737b as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family2/2ad90541d94b431caa8598854250737b 2023-07-11 17:55:06,063 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2ad90541d94b431caa8598854250737b 2023-07-11 17:55:06,063 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 57075e17d99b4276a56f364037e45cc9 2023-07-11 17:55:06,063 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family2/2ad90541d94b431caa8598854250737b, entries=1, sequenceid=24, filesize=5.0 K 2023-07-11 17:55:06,063 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family2/57075e17d99b4276a56f364037e45cc9, entries=1, sequenceid=24, filesize=5.0 K 2023-07-11 17:55:06,064 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 17aacf583da279539e944e5353cb4f95 in 1673ms, sequenceid=24, compaction requested=true 2023-07-11 17:55:06,064 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 0b68e8a6a3555cdd10a16d0303c35da7 in 1672ms, sequenceid=24, compaction requested=true 2023-07-11 17:55:06,064 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 17aacf583da279539e944e5353cb4f95: 2023-07-11 17:55:06,064 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 0b68e8a6a3555cdd10a16d0303c35da7: 2023-07-11 17:55:06,064 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1689098094325.0b68e8a6a3555cdd10a16d0303c35da7. 2023-07-11 17:55:06,064 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1689098094325.17aacf583da279539e944e5353cb4f95. 2023-07-11 17:55:06,064 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-07-11 17:55:06,064 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-07-11 17:55:06,064 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-07-11 17:55:06,064 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:06,064 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-07-11 17:55:06,064 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-07-11 17:55:06,066 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:06,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:06,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:55:06,066 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-07-11 17:55:06,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:55:06,067 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-07-11 17:55:06,067 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 17:55:06,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:55:06,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:55:06,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-07-11 17:55:06,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:06,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:55:06,068 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-07-11 17:55:06,068 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-07-11 17:55:06,068 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@525e06f1[Count = 0] remaining members to acquire global barrier 2023-07-11 17:55:06,068 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-07-11 17:55:06,073 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-07-11 17:55:06,073 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-07-11 17:55:06,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-07-11 17:55:06,073 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-07-11 17:55:06,073 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-07-11 17:55:06,073 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:06,073 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 17:55:06,073 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase9.apache.org,45839,1689097999112' in zk 2023-07-11 17:55:06,074 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-07-11 17:55:06,074 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:55:06,074 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:06,075 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-07-11 17:55:06,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:06,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:55:06,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:55:06,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:55:06,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:55:06,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-07-11 17:55:06,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:06,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:55:06,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-07-11 17:55:06,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:06,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase9.apache.org,45839,1689097999112': 2023-07-11 17:55:06,077 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-07-11 17:55:06,077 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-07-11 17:55:06,077 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 17:55:06,077 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 17:55:06,077 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-07-11 17:55:06,077 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 17:55:06,078 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-07-11 17:55:06,078 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-07-11 17:55:06,079 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-07-11 17:55:06,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-07-11 17:55:06,079 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:55:06,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-07-11 17:55:06,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:55:06,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:55:06,079 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:55:06,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:55:06,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:55:06,079 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:06,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-07-11 17:55:06,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-07-11 17:55:06,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:55:06,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-07-11 17:55:06,080 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:06,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:06,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:55:06,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-07-11 17:55:06,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:06,085 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:06,085 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:55:06,085 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-07-11 17:55:06,085 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-07-11 17:55:06,085 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-07-11 17:55:06,085 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 17:55:06,086 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:06,085 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:55:06,085 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:55:06,085 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:55:06,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:55:06,086 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-07-11 17:55:06,086 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-07-11 17:55:06,086 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 17:55:06,086 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-07-11 17:55:06,086 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:55:06,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:55:06,086 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-07-11 17:55:06,186 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 17:55:06,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 17:55:06,188 DEBUG [Listener at localhost/43271] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-07-11 17:55:06,188 DEBUG [Listener at localhost/43271] regionserver.HStore(1912): 17aacf583da279539e944e5353cb4f95/family1 is initiating major compaction (all files) 2023-07-11 17:55:06,188 INFO [Listener at localhost/43271] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-11 17:55:06,188 INFO [Listener at localhost/43271] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-11 17:55:06,188 INFO [Listener at localhost/43271] regionserver.HRegion(2259): Starting compaction of 17aacf583da279539e944e5353cb4f95/family1 in testCompactionWithHFileLink,2,1689098094325.17aacf583da279539e944e5353cb4f95. 2023-07-11 17:55:06,188 INFO [Listener at localhost/43271] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family1/5a91189cc1db4a21b3f357d74add3143, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family1/e23b0c73b533452b95b0ad7a117cc636, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family1/c3c64e60ba094d8eb876fc9b98feec64, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family1/f9f5f943383c4935bf464d264c2e9f15, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family1/1c76b7c815ca4a7f89cffa4e62e9ea34] into tmpdir=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/.tmp, totalSize=26.7 K 2023-07-11 17:55:06,189 DEBUG [Listener at localhost/43271] compactions.Compactor(207): Compacting 5a91189cc1db4a21b3f357d74add3143, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1689098096443 2023-07-11 17:55:06,189 DEBUG [Listener at localhost/43271] compactions.Compactor(207): Compacting e23b0c73b533452b95b0ad7a117cc636, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1689098098227 2023-07-11 17:55:06,190 DEBUG [Listener at localhost/43271] compactions.Compactor(207): Compacting c3c64e60ba094d8eb876fc9b98feec64, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1689098099619 2023-07-11 17:55:06,190 DEBUG [Listener at localhost/43271] compactions.Compactor(207): Compacting f9f5f943383c4935bf464d264c2e9f15, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1689098101022 2023-07-11 17:55:06,190 DEBUG [Listener at localhost/43271] compactions.Compactor(207): Compacting 1c76b7c815ca4a7f89cffa4e62e9ea34, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-07-11 17:55:06,202 INFO [Listener at localhost/43271] throttle.PressureAwareThroughputController(145): 17aacf583da279539e944e5353cb4f95#family1#compaction#107 average throughput is 0.85 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-11 17:55:06,611 INFO [Listener at localhost/43271] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20230711f09c40ee29ae47af8f9bb389063dbdef_del 2023-07-11 17:55:06,611 INFO [Listener at localhost/43271] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230711f09c40ee29ae47af8f9bb389063dbdef_del to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230711f09c40ee29ae47af8f9bb389063dbdef_del 2023-07-11 17:55:07,424 INFO [Listener at localhost/43271] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c957c68860964213906a327218f22ff6 2023-07-11 17:55:07,425 DEBUG [Listener at localhost/43271] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/.tmp/family1/c957c68860964213906a327218f22ff6 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family1/c957c68860964213906a327218f22ff6 2023-07-11 17:55:07,429 INFO [Listener at localhost/43271] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c957c68860964213906a327218f22ff6 2023-07-11 17:55:07,430 INFO [Listener at localhost/43271] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 17aacf583da279539e944e5353cb4f95/family1 of 17aacf583da279539e944e5353cb4f95 into c957c68860964213906a327218f22ff6(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-07-11 17:55:07,430 DEBUG [Listener at localhost/43271] regionserver.HRegion(2289): Compaction status journal for 17aacf583da279539e944e5353cb4f95: 2023-07-11 17:55:07,431 DEBUG [Listener at localhost/43271] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-07-11 17:55:07,431 DEBUG [Listener at localhost/43271] regionserver.HStore(1912): 17aacf583da279539e944e5353cb4f95/family2 is initiating major compaction (all files) 2023-07-11 17:55:07,431 INFO [Listener at localhost/43271] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-11 17:55:07,431 INFO [Listener at localhost/43271] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-11 17:55:07,432 INFO [Listener at localhost/43271] regionserver.HRegion(2259): Starting compaction of 17aacf583da279539e944e5353cb4f95/family2 in testCompactionWithHFileLink,2,1689098094325.17aacf583da279539e944e5353cb4f95. 2023-07-11 17:55:07,432 INFO [Listener at localhost/43271] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family2/93d53e1b8309484aa3e0289e23d040ab, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family2/cccfc7c128044a978c31c85a74c6959a, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family2/4adc47622f2a4637b3b54cce04c04b6e, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family2/ebe0cbb7380846508944493a19164584, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family2/2ad90541d94b431caa8598854250737b] into tmpdir=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/.tmp, totalSize=25.4 K 2023-07-11 17:55:07,432 DEBUG [Listener at localhost/43271] compactions.Compactor(207): Compacting 93d53e1b8309484aa3e0289e23d040ab, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1689098096443 2023-07-11 17:55:07,433 DEBUG [Listener at localhost/43271] compactions.Compactor(207): Compacting cccfc7c128044a978c31c85a74c6959a, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1689098098227 2023-07-11 17:55:07,433 DEBUG [Listener at localhost/43271] compactions.Compactor(207): Compacting 4adc47622f2a4637b3b54cce04c04b6e, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1689098099619 2023-07-11 17:55:07,434 DEBUG [Listener at localhost/43271] compactions.Compactor(207): Compacting ebe0cbb7380846508944493a19164584, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1689098101022 2023-07-11 17:55:07,434 DEBUG [Listener at localhost/43271] compactions.Compactor(207): Compacting 2ad90541d94b431caa8598854250737b, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-07-11 17:55:07,437 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family1/5a91189cc1db4a21b3f357d74add3143, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family1/e23b0c73b533452b95b0ad7a117cc636, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family1/c3c64e60ba094d8eb876fc9b98feec64, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family1/f9f5f943383c4935bf464d264c2e9f15, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family1/1c76b7c815ca4a7f89cffa4e62e9ea34] to archive 2023-07-11 17:55:07,438 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 17:55:07,439 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family1/5a91189cc1db4a21b3f357d74add3143 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family1/5a91189cc1db4a21b3f357d74add3143 2023-07-11 17:55:07,442 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family1/e23b0c73b533452b95b0ad7a117cc636 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family1/e23b0c73b533452b95b0ad7a117cc636 2023-07-11 17:55:07,444 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family1/c3c64e60ba094d8eb876fc9b98feec64 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family1/c3c64e60ba094d8eb876fc9b98feec64 2023-07-11 17:55:07,445 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family1/f9f5f943383c4935bf464d264c2e9f15 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family1/f9f5f943383c4935bf464d264c2e9f15 2023-07-11 17:55:07,446 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family1/1c76b7c815ca4a7f89cffa4e62e9ea34 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family1/1c76b7c815ca4a7f89cffa4e62e9ea34 2023-07-11 17:55:07,457 INFO [Listener at localhost/43271] throttle.PressureAwareThroughputController(145): 17aacf583da279539e944e5353cb4f95#family2#compaction#108 average throughput is 0.35 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-11 17:55:07,866 INFO [Listener at localhost/43271] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c2023071108721711bd25494883d6439202c9ed0f_del 2023-07-11 17:55:07,867 INFO [Listener at localhost/43271] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023071108721711bd25494883d6439202c9ed0f_del to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023071108721711bd25494883d6439202c9ed0f_del 2023-07-11 17:55:08,284 INFO [Listener at localhost/43271] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 468a3779cb0a4ac08c6cbd0b75347952 2023-07-11 17:55:08,285 DEBUG [Listener at localhost/43271] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/.tmp/family2/468a3779cb0a4ac08c6cbd0b75347952 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family2/468a3779cb0a4ac08c6cbd0b75347952 2023-07-11 17:55:08,288 INFO [Listener at localhost/43271] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 468a3779cb0a4ac08c6cbd0b75347952 2023-07-11 17:55:08,289 INFO [Listener at localhost/43271] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 17aacf583da279539e944e5353cb4f95/family2 of 17aacf583da279539e944e5353cb4f95 into 468a3779cb0a4ac08c6cbd0b75347952(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-11 17:55:08,289 DEBUG [Listener at localhost/43271] regionserver.HRegion(2289): Compaction status journal for 17aacf583da279539e944e5353cb4f95: 2023-07-11 17:55:08,289 DEBUG [Listener at localhost/43271] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-07-11 17:55:08,289 DEBUG [Listener at localhost/43271] regionserver.HStore(1912): c13bb432df8709c95734bd08b015997b/family1 is initiating major compaction (all files) 2023-07-11 17:55:08,290 INFO [Listener at localhost/43271] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-11 17:55:08,290 INFO [Listener at localhost/43271] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-11 17:55:08,290 INFO [Listener at localhost/43271] regionserver.HRegion(2259): Starting compaction of c13bb432df8709c95734bd08b015997b/family1 in testCompactionWithHFileLink,1,1689098094325.c13bb432df8709c95734bd08b015997b. 2023-07-11 17:55:08,290 INFO [Listener at localhost/43271] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family1/76b71e8b082a4db9a277c10783c7028f, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family1/30f4c31959d44a41b966543ef2a39e52, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family1/81e1f065bb5d4f5c8f55b71da3938881, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family1/4a50c361db254e91bf01d52a3e927bcd, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family1/1bc38544d7464d2ba2b6d994c0bba775] into tmpdir=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/.tmp, totalSize=26.7 K 2023-07-11 17:55:08,290 DEBUG [Listener at localhost/43271] compactions.Compactor(207): Compacting 76b71e8b082a4db9a277c10783c7028f, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1689098096442 2023-07-11 17:55:08,291 DEBUG [Listener at localhost/43271] compactions.Compactor(207): Compacting 30f4c31959d44a41b966543ef2a39e52, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1689098098227 2023-07-11 17:55:08,291 DEBUG [Listener at localhost/43271] compactions.Compactor(207): Compacting 81e1f065bb5d4f5c8f55b71da3938881, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1689098099619 2023-07-11 17:55:08,291 DEBUG [Listener at localhost/43271] compactions.Compactor(207): Compacting 4a50c361db254e91bf01d52a3e927bcd, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1689098101021 2023-07-11 17:55:08,292 DEBUG [Listener at localhost/43271] compactions.Compactor(207): Compacting 1bc38544d7464d2ba2b6d994c0bba775, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-07-11 17:55:08,307 INFO [Listener at localhost/43271] throttle.PressureAwareThroughputController(145): c13bb432df8709c95734bd08b015997b#family1#compaction#109 average throughput is 0.24 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-11 17:55:08,336 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family2/93d53e1b8309484aa3e0289e23d040ab, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family2/cccfc7c128044a978c31c85a74c6959a, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family2/4adc47622f2a4637b3b54cce04c04b6e, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family2/ebe0cbb7380846508944493a19164584, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family2/2ad90541d94b431caa8598854250737b] to archive 2023-07-11 17:55:08,337 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 17:55:08,339 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family2/93d53e1b8309484aa3e0289e23d040ab to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family2/93d53e1b8309484aa3e0289e23d040ab 2023-07-11 17:55:08,340 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family2/cccfc7c128044a978c31c85a74c6959a to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family2/cccfc7c128044a978c31c85a74c6959a 2023-07-11 17:55:08,341 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family2/4adc47622f2a4637b3b54cce04c04b6e to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family2/4adc47622f2a4637b3b54cce04c04b6e 2023-07-11 17:55:08,342 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family2/ebe0cbb7380846508944493a19164584 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family2/ebe0cbb7380846508944493a19164584 2023-07-11 17:55:08,343 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family2/2ad90541d94b431caa8598854250737b to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family2/2ad90541d94b431caa8598854250737b 2023-07-11 17:55:08,716 INFO [Listener at localhost/43271] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b2023071162eea5aff6ac48bab5922c14a0a6d785_del 2023-07-11 17:55:08,716 INFO [Listener at localhost/43271] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023071162eea5aff6ac48bab5922c14a0a6d785_del to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023071162eea5aff6ac48bab5922c14a0a6d785_del 2023-07-11 17:55:09,530 INFO [Listener at localhost/43271] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 74141df7df2c4b1fb1a953968e37bc9c 2023-07-11 17:55:09,530 DEBUG [Listener at localhost/43271] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/.tmp/family1/74141df7df2c4b1fb1a953968e37bc9c as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family1/74141df7df2c4b1fb1a953968e37bc9c 2023-07-11 17:55:09,534 INFO [Listener at localhost/43271] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 74141df7df2c4b1fb1a953968e37bc9c 2023-07-11 17:55:09,535 INFO [Listener at localhost/43271] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in c13bb432df8709c95734bd08b015997b/family1 of c13bb432df8709c95734bd08b015997b into 74141df7df2c4b1fb1a953968e37bc9c(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-07-11 17:55:09,535 DEBUG [Listener at localhost/43271] regionserver.HRegion(2289): Compaction status journal for c13bb432df8709c95734bd08b015997b: 2023-07-11 17:55:09,535 DEBUG [Listener at localhost/43271] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-07-11 17:55:09,535 DEBUG [Listener at localhost/43271] regionserver.HStore(1912): c13bb432df8709c95734bd08b015997b/family2 is initiating major compaction (all files) 2023-07-11 17:55:09,535 INFO [Listener at localhost/43271] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-11 17:55:09,536 INFO [Listener at localhost/43271] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-11 17:55:09,536 INFO [Listener at localhost/43271] regionserver.HRegion(2259): Starting compaction of c13bb432df8709c95734bd08b015997b/family2 in testCompactionWithHFileLink,1,1689098094325.c13bb432df8709c95734bd08b015997b. 2023-07-11 17:55:09,536 INFO [Listener at localhost/43271] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family2/02c2a20c070443429b770182c7743f19, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family2/53a30bd9c0034d4184a04d4074cea82d, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family2/4fd592c4b4f8466e88ff4f127c71d5ef, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family2/26f71c895e82431b9c24d88865e336be, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family2/d408114b42d44cfb8acb1b55b0729681] into tmpdir=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/.tmp, totalSize=25.4 K 2023-07-11 17:55:09,536 DEBUG [Listener at localhost/43271] compactions.Compactor(207): Compacting 02c2a20c070443429b770182c7743f19, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1689098096442 2023-07-11 17:55:09,536 DEBUG [Listener at localhost/43271] compactions.Compactor(207): Compacting 53a30bd9c0034d4184a04d4074cea82d, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1689098098227 2023-07-11 17:55:09,537 DEBUG [Listener at localhost/43271] compactions.Compactor(207): Compacting 4fd592c4b4f8466e88ff4f127c71d5ef, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1689098099619 2023-07-11 17:55:09,537 DEBUG [Listener at localhost/43271] compactions.Compactor(207): Compacting 26f71c895e82431b9c24d88865e336be, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1689098101021 2023-07-11 17:55:09,537 DEBUG [Listener at localhost/43271] compactions.Compactor(207): Compacting d408114b42d44cfb8acb1b55b0729681, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-07-11 17:55:09,544 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family1/76b71e8b082a4db9a277c10783c7028f, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family1/30f4c31959d44a41b966543ef2a39e52, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family1/81e1f065bb5d4f5c8f55b71da3938881, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family1/4a50c361db254e91bf01d52a3e927bcd, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family1/1bc38544d7464d2ba2b6d994c0bba775] to archive 2023-07-11 17:55:09,545 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 17:55:09,547 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family1/76b71e8b082a4db9a277c10783c7028f to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family1/76b71e8b082a4db9a277c10783c7028f 2023-07-11 17:55:09,547 INFO [Listener at localhost/43271] throttle.PressureAwareThroughputController(145): c13bb432df8709c95734bd08b015997b#family2#compaction#110 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-11 17:55:09,548 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family1/30f4c31959d44a41b966543ef2a39e52 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family1/30f4c31959d44a41b966543ef2a39e52 2023-07-11 17:55:09,549 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family1/81e1f065bb5d4f5c8f55b71da3938881 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family1/81e1f065bb5d4f5c8f55b71da3938881 2023-07-11 17:55:09,550 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family1/4a50c361db254e91bf01d52a3e927bcd to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family1/4a50c361db254e91bf01d52a3e927bcd 2023-07-11 17:55:09,551 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family1/1bc38544d7464d2ba2b6d994c0bba775 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family1/1bc38544d7464d2ba2b6d994c0bba775 2023-07-11 17:55:09,956 INFO [Listener at localhost/43271] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b2023071160eae1bb5ce84d8f8c0368fa84e62345_del 2023-07-11 17:55:09,956 INFO [Listener at localhost/43271] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023071160eae1bb5ce84d8f8c0368fa84e62345_del to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023071160eae1bb5ce84d8f8c0368fa84e62345_del 2023-07-11 17:55:10,772 INFO [Listener at localhost/43271] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e58187be82ef4afb8143f7ff1dd340d5 2023-07-11 17:55:10,774 DEBUG [Listener at localhost/43271] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/.tmp/family2/e58187be82ef4afb8143f7ff1dd340d5 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family2/e58187be82ef4afb8143f7ff1dd340d5 2023-07-11 17:55:10,785 INFO [Listener at localhost/43271] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e58187be82ef4afb8143f7ff1dd340d5 2023-07-11 17:55:10,786 INFO [Listener at localhost/43271] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in c13bb432df8709c95734bd08b015997b/family2 of c13bb432df8709c95734bd08b015997b into e58187be82ef4afb8143f7ff1dd340d5(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-07-11 17:55:10,786 DEBUG [Listener at localhost/43271] regionserver.HRegion(2289): Compaction status journal for c13bb432df8709c95734bd08b015997b: 2023-07-11 17:55:10,787 DEBUG [Listener at localhost/43271] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-07-11 17:55:10,787 DEBUG [Listener at localhost/43271] regionserver.HStore(1912): 0b68e8a6a3555cdd10a16d0303c35da7/family1 is initiating major compaction (all files) 2023-07-11 17:55:10,787 INFO [Listener at localhost/43271] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-11 17:55:10,787 INFO [Listener at localhost/43271] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-11 17:55:10,788 INFO [Listener at localhost/43271] regionserver.HRegion(2259): Starting compaction of 0b68e8a6a3555cdd10a16d0303c35da7/family1 in testCompactionWithHFileLink,,1689098094325.0b68e8a6a3555cdd10a16d0303c35da7. 2023-07-11 17:55:10,788 INFO [Listener at localhost/43271] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family1/a707ff33e39949af81987160f0ba5530, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family1/ba7bb4ba5b4b4f56bf5eb50df7f9ec97, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family1/2ae88bcf87d84d07aad6592c3af1a04d, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family1/573c26d7757245d6943f5d881e9bc774, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family1/b2922041196743828f005b0c59e6464d] into tmpdir=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/.tmp, totalSize=26.7 K 2023-07-11 17:55:10,789 DEBUG [Listener at localhost/43271] compactions.Compactor(207): Compacting a707ff33e39949af81987160f0ba5530, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1689098096440 2023-07-11 17:55:10,790 DEBUG [Listener at localhost/43271] compactions.Compactor(207): Compacting ba7bb4ba5b4b4f56bf5eb50df7f9ec97, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1689098098226 2023-07-11 17:55:10,790 DEBUG [Listener at localhost/43271] compactions.Compactor(207): Compacting 2ae88bcf87d84d07aad6592c3af1a04d, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1689098099619 2023-07-11 17:55:10,791 DEBUG [Listener at localhost/43271] compactions.Compactor(207): Compacting 573c26d7757245d6943f5d881e9bc774, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1689098101021 2023-07-11 17:55:10,792 DEBUG [Listener at localhost/43271] compactions.Compactor(207): Compacting b2922041196743828f005b0c59e6464d, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-07-11 17:55:10,838 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family2/02c2a20c070443429b770182c7743f19, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family2/53a30bd9c0034d4184a04d4074cea82d, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family2/4fd592c4b4f8466e88ff4f127c71d5ef, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family2/26f71c895e82431b9c24d88865e336be, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family2/d408114b42d44cfb8acb1b55b0729681] to archive 2023-07-11 17:55:10,838 INFO [Listener at localhost/43271] throttle.PressureAwareThroughputController(145): 0b68e8a6a3555cdd10a16d0303c35da7#family1#compaction#111 average throughput is 0.07 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-11 17:55:10,839 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 17:55:10,842 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family2/02c2a20c070443429b770182c7743f19 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family2/02c2a20c070443429b770182c7743f19 2023-07-11 17:55:10,844 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family2/53a30bd9c0034d4184a04d4074cea82d to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family2/53a30bd9c0034d4184a04d4074cea82d 2023-07-11 17:55:10,846 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family2/4fd592c4b4f8466e88ff4f127c71d5ef to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family2/4fd592c4b4f8466e88ff4f127c71d5ef 2023-07-11 17:55:10,848 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family2/26f71c895e82431b9c24d88865e336be to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family2/26f71c895e82431b9c24d88865e336be 2023-07-11 17:55:10,851 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family2/d408114b42d44cfb8acb1b55b0729681 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family2/d408114b42d44cfb8acb1b55b0729681 2023-07-11 17:55:10,874 INFO [Listener at localhost/43271] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202307119beb56ffc6144be3bb7e6cc0666b23de_del 2023-07-11 17:55:10,874 INFO [Listener at localhost/43271] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307119beb56ffc6144be3bb7e6cc0666b23de_del to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202307119beb56ffc6144be3bb7e6cc0666b23de_del 2023-07-11 17:55:10,945 INFO [Listener at localhost/43271] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 69b7064ddc3b4156a49c49e7eaa02178 2023-07-11 17:55:10,946 DEBUG [Listener at localhost/43271] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/.tmp/family1/69b7064ddc3b4156a49c49e7eaa02178 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family1/69b7064ddc3b4156a49c49e7eaa02178 2023-07-11 17:55:10,951 INFO [Listener at localhost/43271] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 69b7064ddc3b4156a49c49e7eaa02178 2023-07-11 17:55:10,952 INFO [Listener at localhost/43271] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 0b68e8a6a3555cdd10a16d0303c35da7/family1 of 0b68e8a6a3555cdd10a16d0303c35da7 into 69b7064ddc3b4156a49c49e7eaa02178(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-11 17:55:10,952 DEBUG [Listener at localhost/43271] regionserver.HRegion(2289): Compaction status journal for 0b68e8a6a3555cdd10a16d0303c35da7: 2023-07-11 17:55:10,952 DEBUG [Listener at localhost/43271] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-07-11 17:55:10,952 DEBUG [Listener at localhost/43271] regionserver.HStore(1912): 0b68e8a6a3555cdd10a16d0303c35da7/family2 is initiating major compaction (all files) 2023-07-11 17:55:10,953 INFO [Listener at localhost/43271] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-11 17:55:10,953 INFO [Listener at localhost/43271] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-11 17:55:10,953 INFO [Listener at localhost/43271] regionserver.HRegion(2259): Starting compaction of 0b68e8a6a3555cdd10a16d0303c35da7/family2 in testCompactionWithHFileLink,,1689098094325.0b68e8a6a3555cdd10a16d0303c35da7. 2023-07-11 17:55:10,953 INFO [Listener at localhost/43271] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family2/1f1fcd346abe4a0d82bc870270831a57, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family2/2039c633aed54fb586721637ea9d9e6a, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family2/f947d88b4b43450ea6febcd27f599a5b, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family2/92122c7c52a6480298263dfb61d0b114, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family2/57075e17d99b4276a56f364037e45cc9] into tmpdir=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/.tmp, totalSize=25.4 K 2023-07-11 17:55:10,954 DEBUG [Listener at localhost/43271] compactions.Compactor(207): Compacting 1f1fcd346abe4a0d82bc870270831a57, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1689098096440 2023-07-11 17:55:10,955 DEBUG [Listener at localhost/43271] compactions.Compactor(207): Compacting 2039c633aed54fb586721637ea9d9e6a, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1689098098226 2023-07-11 17:55:10,955 DEBUG [Listener at localhost/43271] compactions.Compactor(207): Compacting f947d88b4b43450ea6febcd27f599a5b, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1689098099619 2023-07-11 17:55:10,956 DEBUG [Listener at localhost/43271] compactions.Compactor(207): Compacting 92122c7c52a6480298263dfb61d0b114, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1689098101021 2023-07-11 17:55:10,957 DEBUG [Listener at localhost/43271] compactions.Compactor(207): Compacting 57075e17d99b4276a56f364037e45cc9, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-07-11 17:55:10,990 INFO [Listener at localhost/43271] throttle.PressureAwareThroughputController(145): 0b68e8a6a3555cdd10a16d0303c35da7#family2#compaction#112 average throughput is 0.13 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-11 17:55:11,012 INFO [Listener at localhost/43271] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202307117a9bf141d1d9400e8a5593fa7b08c0ee_del 2023-07-11 17:55:11,012 INFO [Listener at localhost/43271] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307117a9bf141d1d9400e8a5593fa7b08c0ee_del to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202307117a9bf141d1d9400e8a5593fa7b08c0ee_del 2023-07-11 17:55:11,037 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family1/a707ff33e39949af81987160f0ba5530, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family1/ba7bb4ba5b4b4f56bf5eb50df7f9ec97, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family1/2ae88bcf87d84d07aad6592c3af1a04d, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family1/573c26d7757245d6943f5d881e9bc774, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family1/b2922041196743828f005b0c59e6464d] to archive 2023-07-11 17:55:11,038 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 17:55:11,041 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family1/a707ff33e39949af81987160f0ba5530 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family1/a707ff33e39949af81987160f0ba5530 2023-07-11 17:55:11,042 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family1/ba7bb4ba5b4b4f56bf5eb50df7f9ec97 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family1/ba7bb4ba5b4b4f56bf5eb50df7f9ec97 2023-07-11 17:55:11,044 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family1/2ae88bcf87d84d07aad6592c3af1a04d to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family1/2ae88bcf87d84d07aad6592c3af1a04d 2023-07-11 17:55:11,046 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family1/573c26d7757245d6943f5d881e9bc774 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family1/573c26d7757245d6943f5d881e9bc774 2023-07-11 17:55:11,051 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family1/b2922041196743828f005b0c59e6464d to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family1/b2922041196743828f005b0c59e6464d 2023-07-11 17:55:11,098 INFO [Listener at localhost/43271] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2bfdba22b7fc494e9476bfdf4a1d2290 2023-07-11 17:55:11,100 DEBUG [Listener at localhost/43271] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/.tmp/family2/2bfdba22b7fc494e9476bfdf4a1d2290 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family2/2bfdba22b7fc494e9476bfdf4a1d2290 2023-07-11 17:55:11,107 INFO [Listener at localhost/43271] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2bfdba22b7fc494e9476bfdf4a1d2290 2023-07-11 17:55:11,108 INFO [Listener at localhost/43271] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 0b68e8a6a3555cdd10a16d0303c35da7/family2 of 0b68e8a6a3555cdd10a16d0303c35da7 into 2bfdba22b7fc494e9476bfdf4a1d2290(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-11 17:55:11,109 DEBUG [Listener at localhost/43271] regionserver.HRegion(2289): Compaction status journal for 0b68e8a6a3555cdd10a16d0303c35da7: 2023-07-11 17:55:11,117 DEBUG [Listener at localhost/43271] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-07-11 17:55:11,124 DEBUG [Listener at localhost/43271] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-07-11 17:55:11,134 DEBUG [Listener at localhost/43271] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-07-11 17:55:11,137 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family2/1f1fcd346abe4a0d82bc870270831a57, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family2/2039c633aed54fb586721637ea9d9e6a, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family2/f947d88b4b43450ea6febcd27f599a5b, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family2/92122c7c52a6480298263dfb61d0b114, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family2/57075e17d99b4276a56f364037e45cc9] to archive 2023-07-11 17:55:11,138 DEBUG [Listener at localhost/43271] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-07-11 17:55:11,139 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 17:55:11,148 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family2/1f1fcd346abe4a0d82bc870270831a57 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family2/1f1fcd346abe4a0d82bc870270831a57 2023-07-11 17:55:11,151 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family2/2039c633aed54fb586721637ea9d9e6a to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family2/2039c633aed54fb586721637ea9d9e6a 2023-07-11 17:55:11,154 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family2/f947d88b4b43450ea6febcd27f599a5b to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family2/f947d88b4b43450ea6febcd27f599a5b 2023-07-11 17:55:11,155 INFO [Listener at localhost/43271] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-07-11 17:55:11,157 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family2/92122c7c52a6480298263dfb61d0b114 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family2/92122c7c52a6480298263dfb61d0b114 2023-07-11 17:55:11,158 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family2/57075e17d99b4276a56f364037e45cc9 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family2/57075e17d99b4276a56f364037e45cc9 2023-07-11 17:55:11,247 INFO [Listener at localhost/43271] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 3 del files, 12 selected files, and 0 irrelevant files table 'testCompactionWithHFileLink' and column 'family1' 2023-07-11 17:55:11,255 INFO [Listener at localhost/43271] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202307119beb56ffc6144be3bb7e6cc0666b23de_del 2023-07-11 17:55:11,268 INFO [Listener at localhost/43271] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b2023071162eea5aff6ac48bab5922c14a0a6d785_del 2023-07-11 17:55:11,274 INFO [Listener at localhost/43271] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20230711f09c40ee29ae47af8f9bb389063dbdef_del 2023-07-11 17:55:11,275 INFO [Listener at localhost/43271] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='testCompactionWithHFileLink' column='family1' 2023-07-11 17:55:11,275 DEBUG [Listener at localhost/43271] zookeeper.ReadOnlyZKClient(139): Connect 0x0fe0a3cf to 127.0.0.1:50702 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 17:55:11,286 DEBUG [Listener at localhost/43271] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6952d2ae, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 17:55:11,287 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230711 for table='testCompactionWithHFileLink' and column='family1' 2023-07-11 17:55:11,287 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230711 for table='testCompactionWithHFileLink' and column='family1' 2023-07-11 17:55:11,287 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20230711 for table='testCompactionWithHFileLink' and column='family1' 2023-07-11 17:55:11,504 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230711aebfcd145b8749848eb0d9a711be7309 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230711aebfcd145b8749848eb0d9a711be7309 2023-07-11 17:55:11,506 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230711 table='testCompactionWithHFileLink' column='family1' 2023-07-11 17:55:11,525 DEBUG [MobFileCompactionChore-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 17:55:11,531 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:50138, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 17:55:11,544 DEBUG [MobFileCompactionChore-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-11 17:55:11,548 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:41006, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-11 17:55:11,570 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230711/family1/adc5d9a650b94282b357d0c6bd6d028a first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x07] 2023-07-11 17:55:11,571 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,,1689098094325.0b68e8a6a3555cdd10a16d0303c35da7., hostname=jenkins-hbase9.apache.org,45839,1689097999112, seqNum=2 for row with hfile group [{family1,hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230711/family1/adc5d9a650b94282b357d0c6bd6d028a}] 2023-07-11 17:55:11,583 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(763): Validating hfile at hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230711/family1/adc5d9a650b94282b357d0c6bd6d028a for inclusion in 0b68e8a6a3555cdd10a16d0303c35da7/family1 2023-07-11 17:55:11,586 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x07 2023-07-11 17:55:11,586 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(777): Region bounds: first= last=1 2023-07-11 17:55:11,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HRegion(2446): Flush status journal for 0b68e8a6a3555cdd10a16d0303c35da7: 2023-07-11 17:55:11,588 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230711/family1/adc5d9a650b94282b357d0c6bd6d028a to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testCompactionWithHFileLink__2ogeqsfnnp20tmir1pjc1vube3nrgp2jsrbp5hrum4jig22a62ik1d0eh2eqjj2s/family1/adc5d9a650b94282b357d0c6bd6d028a 2023-07-11 17:55:11,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testCompactionWithHFileLink__2ogeqsfnnp20tmir1pjc1vube3nrgp2jsrbp5hrum4jig22a62ik1d0eh2eqjj2s/family1/adc5d9a650b94282b357d0c6bd6d028a as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family1/49d2a601fbd6450b8c534ec557bd6b9a_SeqId_29_ 2023-07-11 17:55:11,592 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(849): Loaded HFile hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testCompactionWithHFileLink__2ogeqsfnnp20tmir1pjc1vube3nrgp2jsrbp5hrum4jig22a62ik1d0eh2eqjj2s/family1/adc5d9a650b94282b357d0c6bd6d028a into 0b68e8a6a3555cdd10a16d0303c35da7/family1 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family1/49d2a601fbd6450b8c534ec557bd6b9a_SeqId_29_ - updating store file list. 2023-07-11 17:55:11,599 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(882): Loaded HFile hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family1/49d2a601fbd6450b8c534ec557bd6b9a_SeqId_29_ into 0b68e8a6a3555cdd10a16d0303c35da7/family1 2023-07-11 17:55:11,599 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(855): Successfully loaded hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testCompactionWithHFileLink__2ogeqsfnnp20tmir1pjc1vube3nrgp2jsrbp5hrum4jig22a62ik1d0eh2eqjj2s/family1/adc5d9a650b94282b357d0c6bd6d028a into 0b68e8a6a3555cdd10a16d0303c35da7/family1 (new location: hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family1/49d2a601fbd6450b8c534ec557bd6b9a_SeqId_29_) 2023-07-11 17:55:11,600 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testCompactionWithHFileLink__2ogeqsfnnp20tmir1pjc1vube3nrgp2jsrbp5hrum4jig22a62ik1d0eh2eqjj2s/family1/adc5d9a650b94282b357d0c6bd6d028a 2023-07-11 17:55:11,604 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230711 table='testCompactionWithHFileLink' column='family1' 2023-07-11 17:55:11,605 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 17:55:11,607 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202307111c8fb68fb458472e86510c786c76ca18 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202307111c8fb68fb458472e86510c786c76ca18 2023-07-11 17:55:11,609 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023071191aac97fa1dc4c54a45b2652468490a8 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023071191aac97fa1dc4c54a45b2652468490a8 2023-07-11 17:55:11,610 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230711b9209a6f661046c2bbf3ce8c223e422e to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230711b9209a6f661046c2bbf3ce8c223e422e 2023-07-11 17:55:11,612 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230711dfdabf355e284e7791a42e28492c6e4b to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230711dfdabf355e284e7791a42e28492c6e4b 2023-07-11 17:55:11,612 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-07-11 17:55:11,612 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230711' 2023-07-11 17:55:11,612 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230711 for table='testCompactionWithHFileLink' and column='family1' 2023-07-11 17:55:11,929 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230711bd958799776c44e4a190a11613e76b60 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230711bd958799776c44e4a190a11613e76b60 2023-07-11 17:55:11,930 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230711 table='testCompactionWithHFileLink' column='family1' 2023-07-11 17:55:11,974 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230711/family1/b3cdf1aa72424109932bccc5eaa9ab3b first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x07] 2023-07-11 17:55:11,976 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,1,1689098094325.c13bb432df8709c95734bd08b015997b., hostname=jenkins-hbase9.apache.org,45839,1689097999112, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230711/family1/b3cdf1aa72424109932bccc5eaa9ab3b}] 2023-07-11 17:55:11,979 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(763): Validating hfile at hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230711/family1/b3cdf1aa72424109932bccc5eaa9ab3b for inclusion in c13bb432df8709c95734bd08b015997b/family1 2023-07-11 17:55:11,982 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x07 2023-07-11 17:55:11,982 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(777): Region bounds: first=1 last=2 2023-07-11 17:55:11,982 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HRegion(2446): Flush status journal for c13bb432df8709c95734bd08b015997b: 2023-07-11 17:55:11,983 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230711/family1/b3cdf1aa72424109932bccc5eaa9ab3b to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testCompactionWithHFileLink__uildpamqsufoc1118nu6qq7fnvmpv1edrv8d1ob5sns3332fula4b6uj3g7prnp4/family1/b3cdf1aa72424109932bccc5eaa9ab3b 2023-07-11 17:55:11,986 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testCompactionWithHFileLink__uildpamqsufoc1118nu6qq7fnvmpv1edrv8d1ob5sns3332fula4b6uj3g7prnp4/family1/b3cdf1aa72424109932bccc5eaa9ab3b as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family1/ae675ed464254960b79f9ba1f11bb2b4_SeqId_29_ 2023-07-11 17:55:11,987 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(849): Loaded HFile hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testCompactionWithHFileLink__uildpamqsufoc1118nu6qq7fnvmpv1edrv8d1ob5sns3332fula4b6uj3g7prnp4/family1/b3cdf1aa72424109932bccc5eaa9ab3b into c13bb432df8709c95734bd08b015997b/family1 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family1/ae675ed464254960b79f9ba1f11bb2b4_SeqId_29_ - updating store file list. 2023-07-11 17:55:11,992 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(882): Loaded HFile hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family1/ae675ed464254960b79f9ba1f11bb2b4_SeqId_29_ into c13bb432df8709c95734bd08b015997b/family1 2023-07-11 17:55:11,992 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(855): Successfully loaded hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testCompactionWithHFileLink__uildpamqsufoc1118nu6qq7fnvmpv1edrv8d1ob5sns3332fula4b6uj3g7prnp4/family1/b3cdf1aa72424109932bccc5eaa9ab3b into c13bb432df8709c95734bd08b015997b/family1 (new location: hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family1/ae675ed464254960b79f9ba1f11bb2b4_SeqId_29_) 2023-07-11 17:55:11,992 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testCompactionWithHFileLink__uildpamqsufoc1118nu6qq7fnvmpv1edrv8d1ob5sns3332fula4b6uj3g7prnp4/family1/b3cdf1aa72424109932bccc5eaa9ab3b 2023-07-11 17:55:11,995 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230711 table='testCompactionWithHFileLink' column='family1' 2023-07-11 17:55:11,996 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 17:55:11,997 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230711424207b9ba6e4a258b0a8ebee407947b to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230711424207b9ba6e4a258b0a8ebee407947b 2023-07-11 17:55:12,006 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023071159eb6543927c4caebe900be67b0dc8b1 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023071159eb6543927c4caebe900be67b0dc8b1 2023-07-11 17:55:12,007 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230711c742cd6d9dd143229322deefe82e089f to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230711c742cd6d9dd143229322deefe82e089f 2023-07-11 17:55:12,008 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230711d34c31dca08a4a3d87c90aae83c14ab8 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230711d34c31dca08a4a3d87c90aae83c14ab8 2023-07-11 17:55:12,008 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-07-11 17:55:12,008 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230711' 2023-07-11 17:55:12,009 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20230711 for table='testCompactionWithHFileLink' and column='family1' 2023-07-11 17:55:12,267 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230711a8cf4a214e46481190f45cce957451d7 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230711a8cf4a214e46481190f45cce957451d7 2023-07-11 17:55:12,269 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230711 table='testCompactionWithHFileLink' column='family1' 2023-07-11 17:55:12,320 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230711/family1/be9dab235f334b7684780b2ea3979ad2 first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x07] 2023-07-11 17:55:12,323 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,2,1689098094325.17aacf583da279539e944e5353cb4f95., hostname=jenkins-hbase9.apache.org,45839,1689097999112, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230711/family1/be9dab235f334b7684780b2ea3979ad2}] 2023-07-11 17:55:12,327 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(763): Validating hfile at hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230711/family1/be9dab235f334b7684780b2ea3979ad2 for inclusion in 17aacf583da279539e944e5353cb4f95/family1 2023-07-11 17:55:12,330 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x07 2023-07-11 17:55:12,330 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(777): Region bounds: first=2 last= 2023-07-11 17:55:12,330 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HRegion(2446): Flush status journal for 17aacf583da279539e944e5353cb4f95: 2023-07-11 17:55:12,331 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230711/family1/be9dab235f334b7684780b2ea3979ad2 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testCompactionWithHFileLink__9bqmtp963c1dbmifgkg4mm1i47a25d8a0pgf6e4e9vog7dcnmvs76alo4n1mk7g0/family1/be9dab235f334b7684780b2ea3979ad2 2023-07-11 17:55:12,335 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testCompactionWithHFileLink__9bqmtp963c1dbmifgkg4mm1i47a25d8a0pgf6e4e9vog7dcnmvs76alo4n1mk7g0/family1/be9dab235f334b7684780b2ea3979ad2 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family1/66dea19b43184188b221a3b4ae738c34_SeqId_29_ 2023-07-11 17:55:12,336 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(849): Loaded HFile hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testCompactionWithHFileLink__9bqmtp963c1dbmifgkg4mm1i47a25d8a0pgf6e4e9vog7dcnmvs76alo4n1mk7g0/family1/be9dab235f334b7684780b2ea3979ad2 into 17aacf583da279539e944e5353cb4f95/family1 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family1/66dea19b43184188b221a3b4ae738c34_SeqId_29_ - updating store file list. 2023-07-11 17:55:12,340 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(882): Loaded HFile hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family1/66dea19b43184188b221a3b4ae738c34_SeqId_29_ into 17aacf583da279539e944e5353cb4f95/family1 2023-07-11 17:55:12,340 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(855): Successfully loaded hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testCompactionWithHFileLink__9bqmtp963c1dbmifgkg4mm1i47a25d8a0pgf6e4e9vog7dcnmvs76alo4n1mk7g0/family1/be9dab235f334b7684780b2ea3979ad2 into 17aacf583da279539e944e5353cb4f95/family1 (new location: hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family1/66dea19b43184188b221a3b4ae738c34_SeqId_29_) 2023-07-11 17:55:12,340 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testCompactionWithHFileLink__9bqmtp963c1dbmifgkg4mm1i47a25d8a0pgf6e4e9vog7dcnmvs76alo4n1mk7g0/family1/be9dab235f334b7684780b2ea3979ad2 2023-07-11 17:55:12,344 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230711 table='testCompactionWithHFileLink' column='family1' 2023-07-11 17:55:12,345 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 17:55:12,347 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023071143ec884407d94c27940dfd59e222e6b1 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023071143ec884407d94c27940dfd59e222e6b1 2023-07-11 17:55:12,349 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230711677457bc24104b5390bb726bdfdde12d to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230711677457bc24104b5390bb726bdfdde12d 2023-07-11 17:55:12,351 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023071186b920a80822440fa11dc71ce5c2eda1 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023071186b920a80822440fa11dc71ce5c2eda1 2023-07-11 17:55:12,353 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230711aa14f34b4f9540efbcae4d44c4a026cb to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230711aa14f34b4f9540efbcae4d44c4a026cb 2023-07-11 17:55:12,354 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-07-11 17:55:12,354 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230711' 2023-07-11 17:55:12,354 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230711 for table='testCompactionWithHFileLink' and column='family1' 2023-07-11 17:55:12,354 INFO [Listener at localhost/43271] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testCompactionWithHFileLink' column='family1' 2023-07-11 17:55:12,354 INFO [Listener at localhost/43271] compactions.PartitionedMobCompactor(364): After a mob compaction with all files selected, archiving the del files for table='testCompactionWithHFileLink' and column='family1' 2023-07-11 17:55:12,355 INFO [Listener at localhost/43271] compactions.PartitionedMobCompactor(367): [hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202307119beb56ffc6144be3bb7e6cc0666b23de_del] 2023-07-11 17:55:12,355 DEBUG [Listener at localhost/43271] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 17:55:12,357 DEBUG [Listener at localhost/43271] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202307119beb56ffc6144be3bb7e6cc0666b23de_del to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202307119beb56ffc6144be3bb7e6cc0666b23de_del 2023-07-11 17:55:12,357 INFO [Listener at localhost/43271] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-07-11 17:55:12,358 INFO [Listener at localhost/43271] compactions.PartitionedMobCompactor(367): [hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023071162eea5aff6ac48bab5922c14a0a6d785_del] 2023-07-11 17:55:12,358 DEBUG [Listener at localhost/43271] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 17:55:12,360 DEBUG [Listener at localhost/43271] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023071162eea5aff6ac48bab5922c14a0a6d785_del to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023071162eea5aff6ac48bab5922c14a0a6d785_del 2023-07-11 17:55:12,360 INFO [Listener at localhost/43271] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-07-11 17:55:12,360 INFO [Listener at localhost/43271] compactions.PartitionedMobCompactor(367): [hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230711f09c40ee29ae47af8f9bb389063dbdef_del] 2023-07-11 17:55:12,361 DEBUG [Listener at localhost/43271] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 17:55:12,363 DEBUG [Listener at localhost/43271] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230711f09c40ee29ae47af8f9bb389063dbdef_del to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230711f09c40ee29ae47af8f9bb389063dbdef_del 2023-07-11 17:55:12,363 INFO [Listener at localhost/43271] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-07-11 17:55:12,367 DEBUG [Listener at localhost/43271] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-07-11 17:55:12,370 DEBUG [Listener at localhost/43271] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-07-11 17:55:12,373 DEBUG [Listener at localhost/43271] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-07-11 17:55:12,374 DEBUG [Listener at localhost/43271] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-07-11 17:55:12,386 INFO [Listener at localhost/43271] client.HBaseAdmin$15(890): Started disable of testCompactionWithHFileLink 2023-07-11 17:55:12,386 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.HMaster$11(2418): Client=jenkins//172.31.2.10 disable testCompactionWithHFileLink 2023-07-11 17:55:12,387 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure2.ProcedureExecutor(1029): Stored pid=88, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testCompactionWithHFileLink 2023-07-11 17:55:12,391 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1230): Checking to see if procedure is done pid=88 2023-07-11 17:55:12,391 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689098112391"}]},"ts":"1689098112391"} 2023-07-11 17:55:12,393 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=DISABLING in hbase:meta 2023-07-11 17:55:12,395 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testCompactionWithHFileLink to state=DISABLING 2023-07-11 17:55:12,396 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=89, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=0b68e8a6a3555cdd10a16d0303c35da7, UNASSIGN}, {pid=90, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=c13bb432df8709c95734bd08b015997b, UNASSIGN}, {pid=91, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=17aacf583da279539e944e5353cb4f95, UNASSIGN}] 2023-07-11 17:55:12,398 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=17aacf583da279539e944e5353cb4f95, UNASSIGN 2023-07-11 17:55:12,398 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=90, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=c13bb432df8709c95734bd08b015997b, UNASSIGN 2023-07-11 17:55:12,398 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=89, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=0b68e8a6a3555cdd10a16d0303c35da7, UNASSIGN 2023-07-11 17:55:12,399 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=17aacf583da279539e944e5353cb4f95, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:12,399 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1689098094325.17aacf583da279539e944e5353cb4f95.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1689098112399"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689098112399"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689098112399"}]},"ts":"1689098112399"} 2023-07-11 17:55:12,399 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=90 updating hbase:meta row=c13bb432df8709c95734bd08b015997b, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:12,399 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1689098094325.c13bb432df8709c95734bd08b015997b.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1689098112399"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689098112399"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689098112399"}]},"ts":"1689098112399"} 2023-07-11 17:55:12,400 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=89 updating hbase:meta row=0b68e8a6a3555cdd10a16d0303c35da7, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:12,400 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1689098094325.0b68e8a6a3555cdd10a16d0303c35da7.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1689098112400"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689098112400"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689098112400"}]},"ts":"1689098112400"} 2023-07-11 17:55:12,401 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=92, ppid=91, state=RUNNABLE; CloseRegionProcedure 17aacf583da279539e944e5353cb4f95, server=jenkins-hbase9.apache.org,45839,1689097999112}] 2023-07-11 17:55:12,402 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=90, state=RUNNABLE; CloseRegionProcedure c13bb432df8709c95734bd08b015997b, server=jenkins-hbase9.apache.org,45839,1689097999112}] 2023-07-11 17:55:12,410 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=89, state=RUNNABLE; CloseRegionProcedure 0b68e8a6a3555cdd10a16d0303c35da7, server=jenkins-hbase9.apache.org,45839,1689097999112}] 2023-07-11 17:55:12,492 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1230): Checking to see if procedure is done pid=88 2023-07-11 17:55:12,554 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 0b68e8a6a3555cdd10a16d0303c35da7 2023-07-11 17:55:12,554 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 0b68e8a6a3555cdd10a16d0303c35da7, disabling compactions & flushes 2023-07-11 17:55:12,554 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,,1689098094325.0b68e8a6a3555cdd10a16d0303c35da7. 2023-07-11 17:55:12,554 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,,1689098094325.0b68e8a6a3555cdd10a16d0303c35da7. 2023-07-11 17:55:12,554 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,,1689098094325.0b68e8a6a3555cdd10a16d0303c35da7. after waiting 0 ms 2023-07-11 17:55:12,554 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,,1689098094325.0b68e8a6a3555cdd10a16d0303c35da7. 2023-07-11 17:55:12,569 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-07-11 17:55:12,571 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,,1689098094325.0b68e8a6a3555cdd10a16d0303c35da7. 2023-07-11 17:55:12,571 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 0b68e8a6a3555cdd10a16d0303c35da7: 2023-07-11 17:55:12,572 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 0b68e8a6a3555cdd10a16d0303c35da7 2023-07-11 17:55:12,573 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 17aacf583da279539e944e5353cb4f95 2023-07-11 17:55:12,573 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 17aacf583da279539e944e5353cb4f95, disabling compactions & flushes 2023-07-11 17:55:12,573 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,2,1689098094325.17aacf583da279539e944e5353cb4f95. 2023-07-11 17:55:12,573 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1689098094325.17aacf583da279539e944e5353cb4f95. 2023-07-11 17:55:12,573 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,2,1689098094325.17aacf583da279539e944e5353cb4f95. after waiting 0 ms 2023-07-11 17:55:12,573 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,2,1689098094325.17aacf583da279539e944e5353cb4f95. 2023-07-11 17:55:12,573 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=89 updating hbase:meta row=0b68e8a6a3555cdd10a16d0303c35da7, regionState=CLOSED 2023-07-11 17:55:12,573 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1689098094325.0b68e8a6a3555cdd10a16d0303c35da7.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1689098112573"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689098112573"}]},"ts":"1689098112573"} 2023-07-11 17:55:12,577 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=89 2023-07-11 17:55:12,578 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=89, state=SUCCESS; CloseRegionProcedure 0b68e8a6a3555cdd10a16d0303c35da7, server=jenkins-hbase9.apache.org,45839,1689097999112 in 165 msec 2023-07-11 17:55:12,579 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=89, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=0b68e8a6a3555cdd10a16d0303c35da7, UNASSIGN in 182 msec 2023-07-11 17:55:12,610 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-07-11 17:55:12,612 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,2,1689098094325.17aacf583da279539e944e5353cb4f95. 2023-07-11 17:55:12,612 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 17aacf583da279539e944e5353cb4f95: 2023-07-11 17:55:12,614 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 17aacf583da279539e944e5353cb4f95 2023-07-11 17:55:12,614 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close c13bb432df8709c95734bd08b015997b 2023-07-11 17:55:12,614 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing c13bb432df8709c95734bd08b015997b, disabling compactions & flushes 2023-07-11 17:55:12,614 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,1,1689098094325.c13bb432df8709c95734bd08b015997b. 2023-07-11 17:55:12,614 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1689098094325.c13bb432df8709c95734bd08b015997b. 2023-07-11 17:55:12,614 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,1,1689098094325.c13bb432df8709c95734bd08b015997b. after waiting 0 ms 2023-07-11 17:55:12,614 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,1,1689098094325.c13bb432df8709c95734bd08b015997b. 2023-07-11 17:55:12,614 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=17aacf583da279539e944e5353cb4f95, regionState=CLOSED 2023-07-11 17:55:12,615 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1689098094325.17aacf583da279539e944e5353cb4f95.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1689098112614"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689098112614"}]},"ts":"1689098112614"} 2023-07-11 17:55:12,618 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=92, resume processing ppid=91 2023-07-11 17:55:12,618 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=91, state=SUCCESS; CloseRegionProcedure 17aacf583da279539e944e5353cb4f95, server=jenkins-hbase9.apache.org,45839,1689097999112 in 215 msec 2023-07-11 17:55:12,619 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=17aacf583da279539e944e5353cb4f95, UNASSIGN in 222 msec 2023-07-11 17:55:12,627 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-07-11 17:55:12,628 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,1,1689098094325.c13bb432df8709c95734bd08b015997b. 2023-07-11 17:55:12,629 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for c13bb432df8709c95734bd08b015997b: 2023-07-11 17:55:12,631 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed c13bb432df8709c95734bd08b015997b 2023-07-11 17:55:12,632 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=90 updating hbase:meta row=c13bb432df8709c95734bd08b015997b, regionState=CLOSED 2023-07-11 17:55:12,632 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1689098094325.c13bb432df8709c95734bd08b015997b.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1689098112632"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689098112632"}]},"ts":"1689098112632"} 2023-07-11 17:55:12,635 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=90 2023-07-11 17:55:12,635 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=90, state=SUCCESS; CloseRegionProcedure c13bb432df8709c95734bd08b015997b, server=jenkins-hbase9.apache.org,45839,1689097999112 in 231 msec 2023-07-11 17:55:12,637 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=90, resume processing ppid=88 2023-07-11 17:55:12,637 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=90, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=c13bb432df8709c95734bd08b015997b, UNASSIGN in 239 msec 2023-07-11 17:55:12,638 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689098112638"}]},"ts":"1689098112638"} 2023-07-11 17:55:12,640 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=DISABLED in hbase:meta 2023-07-11 17:55:12,641 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testCompactionWithHFileLink to state=DISABLED 2023-07-11 17:55:12,643 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=88, state=SUCCESS; DisableTableProcedure table=testCompactionWithHFileLink in 256 msec 2023-07-11 17:55:12,693 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1230): Checking to see if procedure is done pid=88 2023-07-11 17:55:12,694 INFO [Listener at localhost/43271] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testCompactionWithHFileLink, procId: 88 completed 2023-07-11 17:55:12,704 INFO [Listener at localhost/43271] client.HBaseAdmin(2586): Taking restore-failsafe snapshot: hbase-failsafe-snaptb-1689098102068-1689098112704 2023-07-11 17:55:12,705 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=hbase-failsafe-snaptb-1689098102068-1689098112704 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-07-11 17:55:12,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689098112705 (current time:1689098112705). 2023-07-11 17:55:12,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-11 17:55:12,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] zookeeper.ReadOnlyZKClient(139): Connect 0x53c21059 to 127.0.0.1:50702 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 17:55:12,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3b1bd292, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 17:55:12,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 17:55:12,713 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:50148, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 17:55:12,714 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x53c21059 to 127.0.0.1:50702 2023-07-11 17:55:12,714 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 17:55:12,714 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-11 17:55:12,714 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] snapshot.SnapshotManager(659): Table is disabled, running snapshot entirely on master for { ss=hbase-failsafe-snaptb-1689098102068-1689098112704 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-07-11 17:55:12,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-07-11 17:55:12,717 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-07-11 17:55:12,717 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE; timeout=600000, timestamp=1689098712717 2023-07-11 17:55:12,718 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] snapshot.SnapshotManager(664): Started snapshot: { ss=hbase-failsafe-snaptb-1689098102068-1689098112704 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-07-11 17:55:12,718 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running DISABLED table snapshot hbase-failsafe-snaptb-1689098102068-1689098112704 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink 2023-07-11 17:55:12,718 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=hbase-failsafe-snaptb-1689098102068-1689098112704 table=testCompactionWithHFileLink type=FLUSH ttl=0 }'' to complete. (max 300000 ms per retry) 2023-07-11 17:55:12,718 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-11 17:55:12,818 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 17:55:12,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1689098102068-1689098112704 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-07-11 17:55:12,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1689098102068-1689098112704 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-07-11 17:55:12,819 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-11 17:55:13,019 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 17:55:13,020 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1689098102068-1689098112704 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-07-11 17:55:13,021 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1689098102068-1689098112704 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-07-11 17:55:13,021 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-11 17:55:13,124 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.DisabledTableSnapshotHandler(97): Starting to write region info and WALs for regions for offline snapshot:{ ss=hbase-failsafe-snaptb-1689098102068-1689098112704 table=testCompactionWithHFileLink type=DISABLED ttl=0 } 2023-07-11 17:55:13,126 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-07-11 17:55:13,126 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-07-11 17:55:13,126 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-07-11 17:55:13,126 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-07-11 17:55:13,126 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-07-11 17:55:13,126 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-07-11 17:55:13,126 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-07-11 17:55:13,126 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-07-11 17:55:13,128 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family1/66dea19b43184188b221a3b4ae738c34_SeqId_29_, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family1/c957c68860964213906a327218f22ff6] hfiles 2023-07-11 17:55:13,128 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family1/66dea19b43184188b221a3b4ae738c34_SeqId_29_ 2023-07-11 17:55:13,129 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family1/c957c68860964213906a327218f22ff6 2023-07-11 17:55:13,129 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family1/49d2a601fbd6450b8c534ec557bd6b9a_SeqId_29_, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family1/69b7064ddc3b4156a49c49e7eaa02178] hfiles 2023-07-11 17:55:13,129 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family1/49d2a601fbd6450b8c534ec557bd6b9a_SeqId_29_ 2023-07-11 17:55:13,129 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family1/69b7064ddc3b4156a49c49e7eaa02178 2023-07-11 17:55:13,129 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family1/74141df7df2c4b1fb1a953968e37bc9c, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family1/ae675ed464254960b79f9ba1f11bb2b4_SeqId_29_] hfiles 2023-07-11 17:55:13,129 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family1/74141df7df2c4b1fb1a953968e37bc9c 2023-07-11 17:55:13,129 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family1/ae675ed464254960b79f9ba1f11bb2b4_SeqId_29_ 2023-07-11 17:55:13,129 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230711bd958799776c44e4a190a11613e76b60, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230711a8cf4a214e46481190f45cce957451d7, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230711aebfcd145b8749848eb0d9a711be7309] hfiles 2023-07-11 17:55:13,129 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (1/3): hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230711bd958799776c44e4a190a11613e76b60 2023-07-11 17:55:13,129 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family2/468a3779cb0a4ac08c6cbd0b75347952] hfiles 2023-07-11 17:55:13,129 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (2/3): hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230711a8cf4a214e46481190f45cce957451d7 2023-07-11 17:55:13,129 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family2/468a3779cb0a4ac08c6cbd0b75347952 2023-07-11 17:55:13,129 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (3/3): hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230711aebfcd145b8749848eb0d9a711be7309 2023-07-11 17:55:13,130 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family2/e58187be82ef4afb8143f7ff1dd340d5] hfiles 2023-07-11 17:55:13,130 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family2/e58187be82ef4afb8143f7ff1dd340d5 2023-07-11 17:55:13,130 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family2/2bfdba22b7fc494e9476bfdf4a1d2290] hfiles 2023-07-11 17:55:13,130 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family2/2bfdba22b7fc494e9476bfdf4a1d2290 2023-07-11 17:55:13,136 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202307114d4befb1d9ec488aa7c800b754123635, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023071160eae1bb5ce84d8f8c0368fa84e62345_del, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023071167d0fee6dc3744318ef79a76b46e637f, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202307118776f0ea9be24e7eb92fb093d0386232, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230711f0df82d81bef489ebc1436d7e4ad3d67, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023071108721711bd25494883d6439202c9ed0f_del, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023071130fd92b9b5924bb1aa9121dace8606f7, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023071151880ab39eb74fcbab8c0532f1534224, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202307117652c7165c3c40febc8cf20a22084b70, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230711bb1d4ef0cd35465f80af67cdc07f9227, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202307111ca3d631751b4c619c804a49c0570166, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230711532554084d014e04ae1f465a0b0dde54, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202307117a9bf141d1d9400e8a5593fa7b08c0ee_del, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230711bc062d43f212492faf7a4f044f1c79bd, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230711beabf5cd3ffa43308073ccb69f996243] hfiles 2023-07-11 17:55:13,136 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (1/15): hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202307114d4befb1d9ec488aa7c800b754123635 2023-07-11 17:55:13,136 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (2/15): hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023071160eae1bb5ce84d8f8c0368fa84e62345_del 2023-07-11 17:55:13,136 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (3/15): hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023071167d0fee6dc3744318ef79a76b46e637f 2023-07-11 17:55:13,136 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (4/15): hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202307118776f0ea9be24e7eb92fb093d0386232 2023-07-11 17:55:13,136 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (5/15): hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230711f0df82d81bef489ebc1436d7e4ad3d67 2023-07-11 17:55:13,136 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (6/15): hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023071108721711bd25494883d6439202c9ed0f_del 2023-07-11 17:55:13,136 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (7/15): hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023071130fd92b9b5924bb1aa9121dace8606f7 2023-07-11 17:55:13,136 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (8/15): hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023071151880ab39eb74fcbab8c0532f1534224 2023-07-11 17:55:13,136 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (9/15): hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202307117652c7165c3c40febc8cf20a22084b70 2023-07-11 17:55:13,136 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (10/15): hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230711bb1d4ef0cd35465f80af67cdc07f9227 2023-07-11 17:55:13,136 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (11/15): hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202307111ca3d631751b4c619c804a49c0570166 2023-07-11 17:55:13,136 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (12/15): hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230711532554084d014e04ae1f465a0b0dde54 2023-07-11 17:55:13,136 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (13/15): hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202307117a9bf141d1d9400e8a5593fa7b08c0ee_del 2023-07-11 17:55:13,136 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (14/15): hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230711bc062d43f212492faf7a4f044f1c79bd 2023-07-11 17:55:13,136 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (15/15): hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230711beabf5cd3ffa43308073ccb69f996243 2023-07-11 17:55:13,321 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 17:55:13,322 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1689098102068-1689098112704 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-07-11 17:55:13,322 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1689098102068-1689098112704 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-07-11 17:55:13,322 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-11 17:55:13,535 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.DisabledTableSnapshotHandler(120): Marking snapshot{ ss=hbase-failsafe-snaptb-1689098102068-1689098112704 table=testCompactionWithHFileLink type=DISABLED ttl=0 } as finished. 2023-07-11 17:55:13,536 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for hbase-failsafe-snaptb-1689098102068-1689098112704 2023-07-11 17:55:13,536 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1689098102068-1689098112704 2023-07-11 17:55:13,662 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1689098102068-1689098112704 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/.hbase-snapshot/hbase-failsafe-snaptb-1689098102068-1689098112704 2023-07-11 17:55:13,734 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot hbase-failsafe-snaptb-1689098102068-1689098112704 of table testCompactionWithHFileLink completed 2023-07-11 17:55:13,735 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1689098102068-1689098112704 2023-07-11 17:55:13,735 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1689098102068-1689098112704 2023-07-11 17:55:13,735 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running DISABLED table snapshot hbase-failsafe-snaptb-1689098102068-1689098112704 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink at 1689098112718Starting to write region info and WALs for regions for offline snapshot:{ ss=hbase-failsafe-snaptb-1689098102068-1689098112704 table=testCompactionWithHFileLink type=DISABLED ttl=0 } at 1689098113124 (+406 ms)Consolidate snapshot: hbase-failsafe-snaptb-1689098102068-1689098112704 at 1689098113536 (+412 ms)Loading Region manifests for hbase-failsafe-snaptb-1689098102068-1689098112704 at 1689098113536Writing data manifest for hbase-failsafe-snaptb-1689098102068-1689098112704 at 1689098113544 (+8 ms)Verifying snapshot: hbase-failsafe-snaptb-1689098102068-1689098112704 at 1689098113592 (+48 ms)Snapshot hbase-failsafe-snaptb-1689098102068-1689098112704 of table testCompactionWithHFileLink completed at 1689098113734 (+142 ms) 2023-07-11 17:55:13,737 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-07-11 17:55:13,739 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE in 1.0210 sec 2023-07-11 17:55:13,822 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 17:55:13,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1689098102068-1689098112704 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-07-11 17:55:13,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] snapshot.SnapshotManager(401): Snapshot '{ ss=hbase-failsafe-snaptb-1689098102068-1689098112704 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-11 17:55:13,902 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE:RESTORE_SNAPSHOT_PRE_OPERATION; RestoreSnapshotProcedure (table=testCompactionWithHFileLink snapshot=name: "snaptb-1689098102068" table: "testCompactionWithHFileLink" creation_time: 1689098102082 type: FLUSH version: 2 ttl: 0 ) 2023-07-11 17:55:13,902 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] snapshot.SnapshotManager(880): Restore snapshot=snaptb-1689098102068 as table=testCompactionWithHFileLink 2023-07-11 17:55:13,905 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1230): Checking to see if procedure is done pid=96 2023-07-11 17:55:14,006 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1230): Checking to see if procedure is done pid=96 2023-07-11 17:55:14,207 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1230): Checking to see if procedure is done pid=96 2023-07-11 17:55:14,312 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000002 2023-07-11 17:55:14,312 DEBUG [PEWorker-1] util.FSTableDescriptors(519): Deleted hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000001 2023-07-11 17:55:14,313 INFO [PEWorker-1] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000002 2023-07-11 17:55:14,313 INFO [PEWorker-1] procedure.RestoreSnapshotProcedure(384): Starting restore snapshot={ ss=snaptb-1689098102068 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-07-11 17:55:14,318 INFO [PEWorker-1] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "snaptb-1689098102068" table: "testCompactionWithHFileLink" creation_time: 1689098102082 type: FLUSH version: 2 ttl: 0 2023-07-11 17:55:14,318 DEBUG [PEWorker-1] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink 2023-07-11 17:55:14,322 DEBUG [PEWorker-1] snapshot.RestoreSnapshotHelper(797): found 3 regions for table=testCompactionWithHFileLink 2023-07-11 17:55:14,326 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230711bd958799776c44e4a190a11613e76b60 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230711bd958799776c44e4a190a11613e76b60 2023-07-11 17:55:14,327 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230711a8cf4a214e46481190f45cce957451d7 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230711a8cf4a214e46481190f45cce957451d7 2023-07-11 17:55:14,328 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230711aebfcd145b8749848eb0d9a711be7309 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230711aebfcd145b8749848eb0d9a711be7309 2023-07-11 17:55:14,328 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b20230711424207b9ba6e4a258b0a8ebee407947b of snapshot=snaptb-1689098102068 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-07-11 17:55:14,331 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b2023071159eb6543927c4caebe900be67b0dc8b1 of snapshot=snaptb-1689098102068 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-07-11 17:55:14,334 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b20230711c742cd6d9dd143229322deefe82e089f of snapshot=snaptb-1689098102068 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-07-11 17:55:14,337 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b20230711d34c31dca08a4a3d87c90aae83c14ab8 of snapshot=snaptb-1689098102068 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-07-11 17:55:14,340 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c2023071143ec884407d94c27940dfd59e222e6b1 of snapshot=snaptb-1689098102068 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-07-11 17:55:14,343 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c20230711677457bc24104b5390bb726bdfdde12d of snapshot=snaptb-1689098102068 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-07-11 17:55:14,346 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c2023071186b920a80822440fa11dc71ce5c2eda1 of snapshot=snaptb-1689098102068 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-07-11 17:55:14,349 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c20230711aa14f34b4f9540efbcae4d44c4a026cb of snapshot=snaptb-1689098102068 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-07-11 17:55:14,352 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e202307111c8fb68fb458472e86510c786c76ca18 of snapshot=snaptb-1689098102068 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-07-11 17:55:14,355 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e2023071191aac97fa1dc4c54a45b2652468490a8 of snapshot=snaptb-1689098102068 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-07-11 17:55:14,357 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e20230711b9209a6f661046c2bbf3ce8c223e422e of snapshot=snaptb-1689098102068 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-07-11 17:55:14,360 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e20230711dfdabf355e284e7791a42e28492c6e4b of snapshot=snaptb-1689098102068 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-07-11 17:55:14,366 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023071108721711bd25494883d6439202c9ed0f_del to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023071108721711bd25494883d6439202c9ed0f_del 2023-07-11 17:55:14,367 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202307117a9bf141d1d9400e8a5593fa7b08c0ee_del to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202307117a9bf141d1d9400e8a5593fa7b08c0ee_del 2023-07-11 17:55:14,368 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023071160eae1bb5ce84d8f8c0368fa84e62345_del to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023071160eae1bb5ce84d8f8c0368fa84e62345_del 2023-07-11 17:55:14,369 INFO [PEWorker-1] snapshot.RestoreSnapshotHelper(223): region to restore: 0b68e8a6a3555cdd10a16d0303c35da7 2023-07-11 17:55:14,369 INFO [PEWorker-1] snapshot.RestoreSnapshotHelper(223): region to restore: 17aacf583da279539e944e5353cb4f95 2023-07-11 17:55:14,369 INFO [PEWorker-1] snapshot.RestoreSnapshotHelper(223): region to restore: c13bb432df8709c95734bd08b015997b 2023-07-11 17:55:14,372 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family1/66dea19b43184188b221a3b4ae738c34_SeqId_29_ to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family1/66dea19b43184188b221a3b4ae738c34_SeqId_29_ 2023-07-11 17:55:14,372 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family1/69b7064ddc3b4156a49c49e7eaa02178 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family1/69b7064ddc3b4156a49c49e7eaa02178 2023-07-11 17:55:14,372 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family1/ae675ed464254960b79f9ba1f11bb2b4_SeqId_29_ to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family1/ae675ed464254960b79f9ba1f11bb2b4_SeqId_29_ 2023-07-11 17:55:14,374 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family1/49d2a601fbd6450b8c534ec557bd6b9a_SeqId_29_ to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family1/49d2a601fbd6450b8c534ec557bd6b9a_SeqId_29_ 2023-07-11 17:55:14,374 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink a707ff33e39949af81987160f0ba5530 of snapshot=snaptb-1689098102068 to region=0b68e8a6a3555cdd10a16d0303c35da7 table=testCompactionWithHFileLink 2023-07-11 17:55:14,374 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family1/74141df7df2c4b1fb1a953968e37bc9c to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family1/74141df7df2c4b1fb1a953968e37bc9c 2023-07-11 17:55:14,374 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family1/c957c68860964213906a327218f22ff6 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family1/c957c68860964213906a327218f22ff6 2023-07-11 17:55:14,374 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 76b71e8b082a4db9a277c10783c7028f of snapshot=snaptb-1689098102068 to region=c13bb432df8709c95734bd08b015997b table=testCompactionWithHFileLink 2023-07-11 17:55:14,374 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 5a91189cc1db4a21b3f357d74add3143 of snapshot=snaptb-1689098102068 to region=17aacf583da279539e944e5353cb4f95 table=testCompactionWithHFileLink 2023-07-11 17:55:14,378 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink ba7bb4ba5b4b4f56bf5eb50df7f9ec97 of snapshot=snaptb-1689098102068 to region=0b68e8a6a3555cdd10a16d0303c35da7 table=testCompactionWithHFileLink 2023-07-11 17:55:14,378 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 30f4c31959d44a41b966543ef2a39e52 of snapshot=snaptb-1689098102068 to region=c13bb432df8709c95734bd08b015997b table=testCompactionWithHFileLink 2023-07-11 17:55:14,378 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink e23b0c73b533452b95b0ad7a117cc636 of snapshot=snaptb-1689098102068 to region=17aacf583da279539e944e5353cb4f95 table=testCompactionWithHFileLink 2023-07-11 17:55:14,385 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 81e1f065bb5d4f5c8f55b71da3938881 of snapshot=snaptb-1689098102068 to region=c13bb432df8709c95734bd08b015997b table=testCompactionWithHFileLink 2023-07-11 17:55:14,385 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 2ae88bcf87d84d07aad6592c3af1a04d of snapshot=snaptb-1689098102068 to region=0b68e8a6a3555cdd10a16d0303c35da7 table=testCompactionWithHFileLink 2023-07-11 17:55:14,386 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c3c64e60ba094d8eb876fc9b98feec64 of snapshot=snaptb-1689098102068 to region=17aacf583da279539e944e5353cb4f95 table=testCompactionWithHFileLink 2023-07-11 17:55:14,389 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 573c26d7757245d6943f5d881e9bc774 of snapshot=snaptb-1689098102068 to region=0b68e8a6a3555cdd10a16d0303c35da7 table=testCompactionWithHFileLink 2023-07-11 17:55:14,389 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink f9f5f943383c4935bf464d264c2e9f15 of snapshot=snaptb-1689098102068 to region=17aacf583da279539e944e5353cb4f95 table=testCompactionWithHFileLink 2023-07-11 17:55:14,389 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 4a50c361db254e91bf01d52a3e927bcd of snapshot=snaptb-1689098102068 to region=c13bb432df8709c95734bd08b015997b table=testCompactionWithHFileLink 2023-07-11 17:55:14,401 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family2/e58187be82ef4afb8143f7ff1dd340d5 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family2/e58187be82ef4afb8143f7ff1dd340d5 2023-07-11 17:55:14,401 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 02c2a20c070443429b770182c7743f19 of snapshot=snaptb-1689098102068 to region=c13bb432df8709c95734bd08b015997b table=testCompactionWithHFileLink 2023-07-11 17:55:14,401 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family2/468a3779cb0a4ac08c6cbd0b75347952 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family2/468a3779cb0a4ac08c6cbd0b75347952 2023-07-11 17:55:14,402 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family2/2bfdba22b7fc494e9476bfdf4a1d2290 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family2/2bfdba22b7fc494e9476bfdf4a1d2290 2023-07-11 17:55:14,402 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 1f1fcd346abe4a0d82bc870270831a57 of snapshot=snaptb-1689098102068 to region=0b68e8a6a3555cdd10a16d0303c35da7 table=testCompactionWithHFileLink 2023-07-11 17:55:14,402 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 93d53e1b8309484aa3e0289e23d040ab of snapshot=snaptb-1689098102068 to region=17aacf583da279539e944e5353cb4f95 table=testCompactionWithHFileLink 2023-07-11 17:55:14,405 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 53a30bd9c0034d4184a04d4074cea82d of snapshot=snaptb-1689098102068 to region=c13bb432df8709c95734bd08b015997b table=testCompactionWithHFileLink 2023-07-11 17:55:14,405 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 2039c633aed54fb586721637ea9d9e6a of snapshot=snaptb-1689098102068 to region=0b68e8a6a3555cdd10a16d0303c35da7 table=testCompactionWithHFileLink 2023-07-11 17:55:14,405 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink cccfc7c128044a978c31c85a74c6959a of snapshot=snaptb-1689098102068 to region=17aacf583da279539e944e5353cb4f95 table=testCompactionWithHFileLink 2023-07-11 17:55:14,414 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 4fd592c4b4f8466e88ff4f127c71d5ef of snapshot=snaptb-1689098102068 to region=c13bb432df8709c95734bd08b015997b table=testCompactionWithHFileLink 2023-07-11 17:55:14,414 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 4adc47622f2a4637b3b54cce04c04b6e of snapshot=snaptb-1689098102068 to region=17aacf583da279539e944e5353cb4f95 table=testCompactionWithHFileLink 2023-07-11 17:55:14,414 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink f947d88b4b43450ea6febcd27f599a5b of snapshot=snaptb-1689098102068 to region=0b68e8a6a3555cdd10a16d0303c35da7 table=testCompactionWithHFileLink 2023-07-11 17:55:14,418 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 26f71c895e82431b9c24d88865e336be of snapshot=snaptb-1689098102068 to region=c13bb432df8709c95734bd08b015997b table=testCompactionWithHFileLink 2023-07-11 17:55:14,418 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 92122c7c52a6480298263dfb61d0b114 of snapshot=snaptb-1689098102068 to region=0b68e8a6a3555cdd10a16d0303c35da7 table=testCompactionWithHFileLink 2023-07-11 17:55:14,418 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink ebe0cbb7380846508944493a19164584 of snapshot=snaptb-1689098102068 to region=17aacf583da279539e944e5353cb4f95 table=testCompactionWithHFileLink 2023-07-11 17:55:14,422 INFO [PEWorker-1] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "snaptb-1689098102068" table: "testCompactionWithHFileLink" creation_time: 1689098102082 type: FLUSH version: 2 ttl: 0 2023-07-11 17:55:14,423 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,,1689098094325.0b68e8a6a3555cdd10a16d0303c35da7.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689098114423"}]},"ts":"9223372036854775807"} 2023-07-11 17:55:14,423 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,2,1689098094325.17aacf583da279539e944e5353cb4f95.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689098114423"}]},"ts":"9223372036854775807"} 2023-07-11 17:55:14,423 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,1,1689098094325.c13bb432df8709c95734bd08b015997b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689098114423"}]},"ts":"9223372036854775807"} 2023-07-11 17:55:14,425 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 3 regions from META 2023-07-11 17:55:14,425 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 0b68e8a6a3555cdd10a16d0303c35da7, NAME => 'testCompactionWithHFileLink,,1689098094325.0b68e8a6a3555cdd10a16d0303c35da7.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 17aacf583da279539e944e5353cb4f95, NAME => 'testCompactionWithHFileLink,2,1689098094325.17aacf583da279539e944e5353cb4f95.', STARTKEY => '2', ENDKEY => ''}, {ENCODED => c13bb432df8709c95734bd08b015997b, NAME => 'testCompactionWithHFileLink,1,1689098094325.c13bb432df8709c95734bd08b015997b.', STARTKEY => '1', ENDKEY => '2'}] 2023-07-11 17:55:14,425 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1689098094325.0b68e8a6a3555cdd10a16d0303c35da7.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1689098114424"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689098114424"}]},"ts":"1689098114424"} 2023-07-11 17:55:14,425 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1689098094325.17aacf583da279539e944e5353cb4f95.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1689098114424"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689098114424"}]},"ts":"1689098114424"} 2023-07-11 17:55:14,425 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1689098094325.c13bb432df8709c95734bd08b015997b.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1689098114424"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689098114424"}]},"ts":"1689098114424"} 2023-07-11 17:55:14,426 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-07-11 17:55:14,426 INFO [PEWorker-1] hbase.MetaTableAccessor(1810): Overwritten 3 regions to Meta 2023-07-11 17:55:14,426 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1811): Overwritten regions: [{ENCODED => 0b68e8a6a3555cdd10a16d0303c35da7, NAME => 'testCompactionWithHFileLink,,1689098094325.0b68e8a6a3555cdd10a16d0303c35da7.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 17aacf583da279539e944e5353cb4f95, NAME => 'testCompactionWithHFileLink,2,1689098094325.17aacf583da279539e944e5353cb4f95.', STARTKEY => '2', ENDKEY => ''}, {ENCODED => c13bb432df8709c95734bd08b015997b, NAME => 'testCompactionWithHFileLink,1,1689098094325.c13bb432df8709c95734bd08b015997b.', STARTKEY => '1', ENDKEY => '2'}] 2023-07-11 17:55:14,427 INFO [PEWorker-1] procedure.RestoreSnapshotProcedure(457): Restore snapshot={ ss=snaptb-1689098102068 table=testCompactionWithHFileLink type=FLUSH ttl=0 } on table=testCompactionWithHFileLink completed! 2023-07-11 17:55:14,429 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; RestoreSnapshotProcedure (table=testCompactionWithHFileLink snapshot=name: "snaptb-1689098102068" table: "testCompactionWithHFileLink" creation_time: 1689098102082 type: FLUSH version: 2 ttl: 0 ) in 535 msec 2023-07-11 17:55:14,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1230): Checking to see if procedure is done pid=96 2023-07-11 17:55:14,508 INFO [Listener at localhost/43271] client.HBaseAdmin$TableFuture(3541): Operation: MODIFY, Table Name: default:testCompactionWithHFileLink, procId: 96 completed 2023-07-11 17:55:14,508 INFO [Listener at localhost/43271] client.HBaseAdmin(2618): Deleting restore-failsafe snapshot: hbase-failsafe-snaptb-1689098102068-1689098112704 2023-07-11 17:55:14,513 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "hbase-failsafe-snaptb-1689098102068-1689098112704" 2023-07-11 17:55:14,515 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] snapshot.SnapshotManager(333): Deleting snapshot: hbase-failsafe-snaptb-1689098102068-1689098112704 2023-07-11 17:55:14,518 INFO [Listener at localhost/43271] client.HBaseAdmin$14(830): Started enable of testCompactionWithHFileLink 2023-07-11 17:55:14,524 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.HMaster$10(2385): Client=jenkins//172.31.2.10 enable testCompactionWithHFileLink 2023-07-11 17:55:14,531 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE:ENABLE_TABLE_PREPARE; EnableTableProcedure table=testCompactionWithHFileLink 2023-07-11 17:55:14,534 INFO [PEWorker-4] procedure.EnableTableProcedure(296): Attempting to enable the table testCompactionWithHFileLink 2023-07-11 17:55:14,534 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689098114534"}]},"ts":"1689098114534"} 2023-07-11 17:55:14,534 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-07-11 17:55:14,536 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLING in hbase:meta 2023-07-11 17:55:14,538 DEBUG [PEWorker-4] procedure.EnableTableProcedure(107): No change in number of region replicas (configuredReplicaCount=1); assigning. 2023-07-11 17:55:14,538 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=0b68e8a6a3555cdd10a16d0303c35da7, ASSIGN}, {pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=c13bb432df8709c95734bd08b015997b, ASSIGN}, {pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=17aacf583da279539e944e5353cb4f95, ASSIGN}] 2023-07-11 17:55:14,540 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=17aacf583da279539e944e5353cb4f95, ASSIGN 2023-07-11 17:55:14,540 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=0b68e8a6a3555cdd10a16d0303c35da7, ASSIGN 2023-07-11 17:55:14,540 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=c13bb432df8709c95734bd08b015997b, ASSIGN 2023-07-11 17:55:14,541 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=17aacf583da279539e944e5353cb4f95, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-07-11 17:55:14,541 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=0b68e8a6a3555cdd10a16d0303c35da7, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-07-11 17:55:14,541 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=c13bb432df8709c95734bd08b015997b, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-07-11 17:55:14,636 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-07-11 17:55:14,692 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=98 updating hbase:meta row=0b68e8a6a3555cdd10a16d0303c35da7, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:14,692 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=17aacf583da279539e944e5353cb4f95, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:14,692 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=99 updating hbase:meta row=c13bb432df8709c95734bd08b015997b, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:14,693 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1689098094325.0b68e8a6a3555cdd10a16d0303c35da7.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1689098114692"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689098114692"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689098114692"}]},"ts":"1689098114692"} 2023-07-11 17:55:14,693 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1689098094325.17aacf583da279539e944e5353cb4f95.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1689098114692"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689098114692"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689098114692"}]},"ts":"1689098114692"} 2023-07-11 17:55:14,693 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1689098094325.c13bb432df8709c95734bd08b015997b.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1689098114692"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689098114692"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689098114692"}]},"ts":"1689098114692"} 2023-07-11 17:55:14,694 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=101, ppid=98, state=RUNNABLE; OpenRegionProcedure 0b68e8a6a3555cdd10a16d0303c35da7, server=jenkins-hbase9.apache.org,45839,1689097999112}] 2023-07-11 17:55:14,696 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=99, state=RUNNABLE; OpenRegionProcedure c13bb432df8709c95734bd08b015997b, server=jenkins-hbase9.apache.org,45839,1689097999112}] 2023-07-11 17:55:14,697 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=100, state=RUNNABLE; OpenRegionProcedure 17aacf583da279539e944e5353cb4f95, server=jenkins-hbase9.apache.org,45839,1689097999112}] 2023-07-11 17:55:14,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-07-11 17:55:14,849 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,1,1689098094325.c13bb432df8709c95734bd08b015997b. 2023-07-11 17:55:14,849 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c13bb432df8709c95734bd08b015997b, NAME => 'testCompactionWithHFileLink,1,1689098094325.c13bb432df8709c95734bd08b015997b.', STARTKEY => '1', ENDKEY => '2'} 2023-07-11 17:55:14,850 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink c13bb432df8709c95734bd08b015997b 2023-07-11 17:55:14,850 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,1,1689098094325.c13bb432df8709c95734bd08b015997b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 17:55:14,850 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for c13bb432df8709c95734bd08b015997b 2023-07-11 17:55:14,850 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for c13bb432df8709c95734bd08b015997b 2023-07-11 17:55:14,854 INFO [StoreOpener-c13bb432df8709c95734bd08b015997b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region c13bb432df8709c95734bd08b015997b 2023-07-11 17:55:14,855 DEBUG [StoreOpener-c13bb432df8709c95734bd08b015997b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family1 2023-07-11 17:55:14,855 DEBUG [StoreOpener-c13bb432df8709c95734bd08b015997b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family1 2023-07-11 17:55:14,855 INFO [StoreOpener-c13bb432df8709c95734bd08b015997b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c13bb432df8709c95734bd08b015997b columnFamilyName family1 2023-07-11 17:55:14,884 DEBUG [StoreOpener-c13bb432df8709c95734bd08b015997b-1] regionserver.HStore(539): loaded hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family1/testCompactionWithHFileLink=c13bb432df8709c95734bd08b015997b-30f4c31959d44a41b966543ef2a39e52 2023-07-11 17:55:14,895 DEBUG [StoreOpener-c13bb432df8709c95734bd08b015997b-1] regionserver.HStore(539): loaded hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family1/testCompactionWithHFileLink=c13bb432df8709c95734bd08b015997b-4a50c361db254e91bf01d52a3e927bcd 2023-07-11 17:55:14,903 DEBUG [StoreOpener-c13bb432df8709c95734bd08b015997b-1] regionserver.HStore(539): loaded hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family1/testCompactionWithHFileLink=c13bb432df8709c95734bd08b015997b-76b71e8b082a4db9a277c10783c7028f 2023-07-11 17:55:14,911 DEBUG [StoreOpener-c13bb432df8709c95734bd08b015997b-1] regionserver.HStore(539): loaded hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family1/testCompactionWithHFileLink=c13bb432df8709c95734bd08b015997b-81e1f065bb5d4f5c8f55b71da3938881 2023-07-11 17:55:14,911 INFO [StoreOpener-c13bb432df8709c95734bd08b015997b-1] regionserver.HStore(310): Store=c13bb432df8709c95734bd08b015997b/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 17:55:14,911 INFO [StoreOpener-c13bb432df8709c95734bd08b015997b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region c13bb432df8709c95734bd08b015997b 2023-07-11 17:55:14,912 DEBUG [StoreOpener-c13bb432df8709c95734bd08b015997b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family2 2023-07-11 17:55:14,912 DEBUG [StoreOpener-c13bb432df8709c95734bd08b015997b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family2 2023-07-11 17:55:14,913 INFO [StoreOpener-c13bb432df8709c95734bd08b015997b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c13bb432df8709c95734bd08b015997b columnFamilyName family2 2023-07-11 17:55:14,922 DEBUG [StoreOpener-c13bb432df8709c95734bd08b015997b-1] regionserver.HStore(539): loaded hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family2/testCompactionWithHFileLink=c13bb432df8709c95734bd08b015997b-02c2a20c070443429b770182c7743f19 2023-07-11 17:55:14,929 DEBUG [StoreOpener-c13bb432df8709c95734bd08b015997b-1] regionserver.HStore(539): loaded hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family2/testCompactionWithHFileLink=c13bb432df8709c95734bd08b015997b-26f71c895e82431b9c24d88865e336be 2023-07-11 17:55:14,942 DEBUG [StoreOpener-c13bb432df8709c95734bd08b015997b-1] regionserver.HStore(539): loaded hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family2/testCompactionWithHFileLink=c13bb432df8709c95734bd08b015997b-4fd592c4b4f8466e88ff4f127c71d5ef 2023-07-11 17:55:14,961 DEBUG [StoreOpener-c13bb432df8709c95734bd08b015997b-1] regionserver.HStore(539): loaded hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family2/testCompactionWithHFileLink=c13bb432df8709c95734bd08b015997b-53a30bd9c0034d4184a04d4074cea82d 2023-07-11 17:55:14,961 INFO [StoreOpener-c13bb432df8709c95734bd08b015997b-1] regionserver.HStore(310): Store=c13bb432df8709c95734bd08b015997b/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 17:55:14,962 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b 2023-07-11 17:55:14,964 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b 2023-07-11 17:55:14,966 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-07-11 17:55:14,967 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for c13bb432df8709c95734bd08b015997b 2023-07-11 17:55:14,968 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened c13bb432df8709c95734bd08b015997b; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70154810, jitterRate=0.04538813233375549}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-07-11 17:55:14,968 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for c13bb432df8709c95734bd08b015997b: 2023-07-11 17:55:14,968 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,1,1689098094325.c13bb432df8709c95734bd08b015997b., pid=102, masterSystemTime=1689098114846 2023-07-11 17:55:14,968 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-11 17:55:14,969 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-07-11 17:55:14,969 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-07-11 17:55:14,969 DEBUG [RS:0;jenkins-hbase9:45839-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-07-11 17:55:14,971 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,1,1689098094325.c13bb432df8709c95734bd08b015997b. 2023-07-11 17:55:14,971 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,1,1689098094325.c13bb432df8709c95734bd08b015997b. 2023-07-11 17:55:14,971 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,2,1689098094325.17aacf583da279539e944e5353cb4f95. 2023-07-11 17:55:14,971 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 17aacf583da279539e944e5353cb4f95, NAME => 'testCompactionWithHFileLink,2,1689098094325.17aacf583da279539e944e5353cb4f95.', STARTKEY => '2', ENDKEY => ''} 2023-07-11 17:55:14,972 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=99 updating hbase:meta row=c13bb432df8709c95734bd08b015997b, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:14,972 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,1,1689098094325.c13bb432df8709c95734bd08b015997b.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1689098114971"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689098114971"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689098114971"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689098114971"}]},"ts":"1689098114971"} 2023-07-11 17:55:14,972 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 17aacf583da279539e944e5353cb4f95 2023-07-11 17:55:14,972 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,2,1689098094325.17aacf583da279539e944e5353cb4f95.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 17:55:14,972 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 17aacf583da279539e944e5353cb4f95 2023-07-11 17:55:14,972 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 17aacf583da279539e944e5353cb4f95 2023-07-11 17:55:14,974 INFO [StoreOpener-17aacf583da279539e944e5353cb4f95-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 17aacf583da279539e944e5353cb4f95 2023-07-11 17:55:14,975 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=99 2023-07-11 17:55:14,975 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=99, state=SUCCESS; OpenRegionProcedure c13bb432df8709c95734bd08b015997b, server=jenkins-hbase9.apache.org,45839,1689097999112 in 277 msec 2023-07-11 17:55:14,975 DEBUG [RS:0;jenkins-hbase9:45839-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-07-11 17:55:14,975 DEBUG [RS:0;jenkins-hbase9:45839-longCompactions-0] regionserver.HStore(1912): c13bb432df8709c95734bd08b015997b/family2 is initiating minor compaction (all files) 2023-07-11 17:55:14,975 INFO [RS:0;jenkins-hbase9:45839-longCompactions-0] regionserver.HRegion(2259): Starting compaction of c13bb432df8709c95734bd08b015997b/family2 in testCompactionWithHFileLink,1,1689098094325.c13bb432df8709c95734bd08b015997b. 2023-07-11 17:55:14,975 INFO [RS:0;jenkins-hbase9:45839-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family2/testCompactionWithHFileLink=c13bb432df8709c95734bd08b015997b-02c2a20c070443429b770182c7743f19, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family2/testCompactionWithHFileLink=c13bb432df8709c95734bd08b015997b-53a30bd9c0034d4184a04d4074cea82d, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family2/testCompactionWithHFileLink=c13bb432df8709c95734bd08b015997b-4fd592c4b4f8466e88ff4f127c71d5ef, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family2/testCompactionWithHFileLink=c13bb432df8709c95734bd08b015997b-26f71c895e82431b9c24d88865e336be] into tmpdir=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/.tmp, totalSize=20.4 K 2023-07-11 17:55:14,976 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 22152 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-07-11 17:55:14,976 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] regionserver.HStore(1912): c13bb432df8709c95734bd08b015997b/family1 is initiating minor compaction (all files) 2023-07-11 17:55:14,976 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=99, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=c13bb432df8709c95734bd08b015997b, ASSIGN in 437 msec 2023-07-11 17:55:14,976 INFO [RS:0;jenkins-hbase9:45839-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of c13bb432df8709c95734bd08b015997b/family1 in testCompactionWithHFileLink,1,1689098094325.c13bb432df8709c95734bd08b015997b. 2023-07-11 17:55:14,976 INFO [RS:0;jenkins-hbase9:45839-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family1/testCompactionWithHFileLink=c13bb432df8709c95734bd08b015997b-76b71e8b082a4db9a277c10783c7028f, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family1/testCompactionWithHFileLink=c13bb432df8709c95734bd08b015997b-30f4c31959d44a41b966543ef2a39e52, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family1/testCompactionWithHFileLink=c13bb432df8709c95734bd08b015997b-81e1f065bb5d4f5c8f55b71da3938881, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family1/testCompactionWithHFileLink=c13bb432df8709c95734bd08b015997b-4a50c361db254e91bf01d52a3e927bcd] into tmpdir=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/.tmp, totalSize=21.6 K 2023-07-11 17:55:14,977 DEBUG [StoreOpener-17aacf583da279539e944e5353cb4f95-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family1 2023-07-11 17:55:14,977 DEBUG [StoreOpener-17aacf583da279539e944e5353cb4f95-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family1 2023-07-11 17:55:14,977 DEBUG [RS:0;jenkins-hbase9:45839-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=c13bb432df8709c95734bd08b015997b-02c2a20c070443429b770182c7743f19, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1689098096442 2023-07-11 17:55:14,977 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=c13bb432df8709c95734bd08b015997b-76b71e8b082a4db9a277c10783c7028f, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1689098096442 2023-07-11 17:55:14,978 INFO [StoreOpener-17aacf583da279539e944e5353cb4f95-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 17aacf583da279539e944e5353cb4f95 columnFamilyName family1 2023-07-11 17:55:14,979 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=c13bb432df8709c95734bd08b015997b-30f4c31959d44a41b966543ef2a39e52, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1689098098227 2023-07-11 17:55:14,980 DEBUG [RS:0;jenkins-hbase9:45839-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=c13bb432df8709c95734bd08b015997b-53a30bd9c0034d4184a04d4074cea82d, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1689098098227 2023-07-11 17:55:14,980 DEBUG [RS:0;jenkins-hbase9:45839-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=c13bb432df8709c95734bd08b015997b-4fd592c4b4f8466e88ff4f127c71d5ef, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1689098099619 2023-07-11 17:55:14,981 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=c13bb432df8709c95734bd08b015997b-81e1f065bb5d4f5c8f55b71da3938881, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1689098099619 2023-07-11 17:55:14,981 DEBUG [RS:0;jenkins-hbase9:45839-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=c13bb432df8709c95734bd08b015997b-26f71c895e82431b9c24d88865e336be, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1689098101021 2023-07-11 17:55:14,982 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=c13bb432df8709c95734bd08b015997b-4a50c361db254e91bf01d52a3e927bcd, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1689098101021 2023-07-11 17:55:15,010 DEBUG [StoreOpener-17aacf583da279539e944e5353cb4f95-1] regionserver.HStore(539): loaded hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family1/testCompactionWithHFileLink=17aacf583da279539e944e5353cb4f95-5a91189cc1db4a21b3f357d74add3143 2023-07-11 17:55:15,020 DEBUG [StoreOpener-17aacf583da279539e944e5353cb4f95-1] regionserver.HStore(539): loaded hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family1/testCompactionWithHFileLink=17aacf583da279539e944e5353cb4f95-c3c64e60ba094d8eb876fc9b98feec64 2023-07-11 17:55:15,030 INFO [RS:0;jenkins-hbase9:45839-shortCompactions-0] throttle.PressureAwareThroughputController(145): c13bb432df8709c95734bd08b015997b#family1#compaction#113 average throughput is 0.39 MB/second, slept 0 time(s) and total slept time is 0 ms. 1 active operations remaining, total limit is 50.00 MB/second 2023-07-11 17:55:15,031 DEBUG [StoreOpener-17aacf583da279539e944e5353cb4f95-1] regionserver.HStore(539): loaded hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family1/testCompactionWithHFileLink=17aacf583da279539e944e5353cb4f95-e23b0c73b533452b95b0ad7a117cc636 2023-07-11 17:55:15,039 INFO [RS:0;jenkins-hbase9:45839-longCompactions-0] throttle.PressureAwareThroughputController(145): c13bb432df8709c95734bd08b015997b#family2#compaction#114 average throughput is 0.13 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-11 17:55:15,043 DEBUG [StoreOpener-17aacf583da279539e944e5353cb4f95-1] regionserver.HStore(539): loaded hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family1/testCompactionWithHFileLink=17aacf583da279539e944e5353cb4f95-f9f5f943383c4935bf464d264c2e9f15 2023-07-11 17:55:15,046 INFO [StoreOpener-17aacf583da279539e944e5353cb4f95-1] regionserver.HStore(310): Store=17aacf583da279539e944e5353cb4f95/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 17:55:15,046 INFO [StoreOpener-17aacf583da279539e944e5353cb4f95-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 17aacf583da279539e944e5353cb4f95 2023-07-11 17:55:15,047 DEBUG [StoreOpener-17aacf583da279539e944e5353cb4f95-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family2 2023-07-11 17:55:15,047 DEBUG [StoreOpener-17aacf583da279539e944e5353cb4f95-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family2 2023-07-11 17:55:15,047 INFO [StoreOpener-17aacf583da279539e944e5353cb4f95-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 17aacf583da279539e944e5353cb4f95 columnFamilyName family2 2023-07-11 17:55:15,056 DEBUG [StoreOpener-17aacf583da279539e944e5353cb4f95-1] regionserver.HStore(539): loaded hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family2/testCompactionWithHFileLink=17aacf583da279539e944e5353cb4f95-4adc47622f2a4637b3b54cce04c04b6e 2023-07-11 17:55:15,062 DEBUG [StoreOpener-17aacf583da279539e944e5353cb4f95-1] regionserver.HStore(539): loaded hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family2/testCompactionWithHFileLink=17aacf583da279539e944e5353cb4f95-93d53e1b8309484aa3e0289e23d040ab 2023-07-11 17:55:15,068 DEBUG [StoreOpener-17aacf583da279539e944e5353cb4f95-1] regionserver.HStore(539): loaded hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family2/testCompactionWithHFileLink=17aacf583da279539e944e5353cb4f95-cccfc7c128044a978c31c85a74c6959a 2023-07-11 17:55:15,076 DEBUG [StoreOpener-17aacf583da279539e944e5353cb4f95-1] regionserver.HStore(539): loaded hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family2/testCompactionWithHFileLink=17aacf583da279539e944e5353cb4f95-ebe0cbb7380846508944493a19164584 2023-07-11 17:55:15,077 INFO [StoreOpener-17aacf583da279539e944e5353cb4f95-1] regionserver.HStore(310): Store=17aacf583da279539e944e5353cb4f95/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 17:55:15,078 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95 2023-07-11 17:55:15,078 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95 2023-07-11 17:55:15,080 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-07-11 17:55:15,081 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 17aacf583da279539e944e5353cb4f95 2023-07-11 17:55:15,082 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 17aacf583da279539e944e5353cb4f95; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71816961, jitterRate=0.07015611231327057}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-07-11 17:55:15,082 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 17aacf583da279539e944e5353cb4f95: 2023-07-11 17:55:15,083 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,2,1689098094325.17aacf583da279539e944e5353cb4f95., pid=103, masterSystemTime=1689098114846 2023-07-11 17:55:15,083 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-07-11 17:55:15,083 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=2), splitQueue=0 2023-07-11 17:55:15,084 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,2,1689098094325.17aacf583da279539e944e5353cb4f95. 2023-07-11 17:55:15,084 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,2,1689098094325.17aacf583da279539e944e5353cb4f95. 2023-07-11 17:55:15,084 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,,1689098094325.0b68e8a6a3555cdd10a16d0303c35da7. 2023-07-11 17:55:15,084 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0b68e8a6a3555cdd10a16d0303c35da7, NAME => 'testCompactionWithHFileLink,,1689098094325.0b68e8a6a3555cdd10a16d0303c35da7.', STARTKEY => '', ENDKEY => '1'} 2023-07-11 17:55:15,085 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=17aacf583da279539e944e5353cb4f95, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:15,085 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 0b68e8a6a3555cdd10a16d0303c35da7 2023-07-11 17:55:15,085 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,,1689098094325.0b68e8a6a3555cdd10a16d0303c35da7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 17:55:15,085 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 0b68e8a6a3555cdd10a16d0303c35da7 2023-07-11 17:55:15,085 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,2,1689098094325.17aacf583da279539e944e5353cb4f95.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1689098115084"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689098115084"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689098115084"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689098115084"}]},"ts":"1689098115084"} 2023-07-11 17:55:15,085 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 0b68e8a6a3555cdd10a16d0303c35da7 2023-07-11 17:55:15,087 INFO [StoreOpener-0b68e8a6a3555cdd10a16d0303c35da7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 0b68e8a6a3555cdd10a16d0303c35da7 2023-07-11 17:55:15,088 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=100 2023-07-11 17:55:15,088 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=100, state=SUCCESS; OpenRegionProcedure 17aacf583da279539e944e5353cb4f95, server=jenkins-hbase9.apache.org,45839,1689097999112 in 389 msec 2023-07-11 17:55:15,088 DEBUG [StoreOpener-0b68e8a6a3555cdd10a16d0303c35da7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family1 2023-07-11 17:55:15,088 DEBUG [StoreOpener-0b68e8a6a3555cdd10a16d0303c35da7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family1 2023-07-11 17:55:15,088 INFO [StoreOpener-0b68e8a6a3555cdd10a16d0303c35da7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0b68e8a6a3555cdd10a16d0303c35da7 columnFamilyName family1 2023-07-11 17:55:15,089 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=17aacf583da279539e944e5353cb4f95, ASSIGN in 550 msec 2023-07-11 17:55:15,097 DEBUG [StoreOpener-0b68e8a6a3555cdd10a16d0303c35da7-1] regionserver.HStore(539): loaded hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family1/testCompactionWithHFileLink=0b68e8a6a3555cdd10a16d0303c35da7-2ae88bcf87d84d07aad6592c3af1a04d 2023-07-11 17:55:15,104 DEBUG [StoreOpener-0b68e8a6a3555cdd10a16d0303c35da7-1] regionserver.HStore(539): loaded hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family1/testCompactionWithHFileLink=0b68e8a6a3555cdd10a16d0303c35da7-573c26d7757245d6943f5d881e9bc774 2023-07-11 17:55:15,109 DEBUG [StoreOpener-0b68e8a6a3555cdd10a16d0303c35da7-1] regionserver.HStore(539): loaded hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family1/testCompactionWithHFileLink=0b68e8a6a3555cdd10a16d0303c35da7-a707ff33e39949af81987160f0ba5530 2023-07-11 17:55:15,118 DEBUG [StoreOpener-0b68e8a6a3555cdd10a16d0303c35da7-1] regionserver.HStore(539): loaded hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family1/testCompactionWithHFileLink=0b68e8a6a3555cdd10a16d0303c35da7-ba7bb4ba5b4b4f56bf5eb50df7f9ec97 2023-07-11 17:55:15,118 INFO [StoreOpener-0b68e8a6a3555cdd10a16d0303c35da7-1] regionserver.HStore(310): Store=0b68e8a6a3555cdd10a16d0303c35da7/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 17:55:15,118 INFO [StoreOpener-0b68e8a6a3555cdd10a16d0303c35da7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 0b68e8a6a3555cdd10a16d0303c35da7 2023-07-11 17:55:15,119 DEBUG [StoreOpener-0b68e8a6a3555cdd10a16d0303c35da7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family2 2023-07-11 17:55:15,119 DEBUG [StoreOpener-0b68e8a6a3555cdd10a16d0303c35da7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family2 2023-07-11 17:55:15,119 INFO [StoreOpener-0b68e8a6a3555cdd10a16d0303c35da7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0b68e8a6a3555cdd10a16d0303c35da7 columnFamilyName family2 2023-07-11 17:55:15,127 DEBUG [StoreOpener-0b68e8a6a3555cdd10a16d0303c35da7-1] regionserver.HStore(539): loaded hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family2/testCompactionWithHFileLink=0b68e8a6a3555cdd10a16d0303c35da7-1f1fcd346abe4a0d82bc870270831a57 2023-07-11 17:55:15,132 DEBUG [StoreOpener-0b68e8a6a3555cdd10a16d0303c35da7-1] regionserver.HStore(539): loaded hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family2/testCompactionWithHFileLink=0b68e8a6a3555cdd10a16d0303c35da7-2039c633aed54fb586721637ea9d9e6a 2023-07-11 17:55:15,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-07-11 17:55:15,139 DEBUG [StoreOpener-0b68e8a6a3555cdd10a16d0303c35da7-1] regionserver.HStore(539): loaded hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family2/testCompactionWithHFileLink=0b68e8a6a3555cdd10a16d0303c35da7-92122c7c52a6480298263dfb61d0b114 2023-07-11 17:55:15,146 DEBUG [StoreOpener-0b68e8a6a3555cdd10a16d0303c35da7-1] regionserver.HStore(539): loaded hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family2/testCompactionWithHFileLink=0b68e8a6a3555cdd10a16d0303c35da7-f947d88b4b43450ea6febcd27f599a5b 2023-07-11 17:55:15,146 INFO [StoreOpener-0b68e8a6a3555cdd10a16d0303c35da7-1] regionserver.HStore(310): Store=0b68e8a6a3555cdd10a16d0303c35da7/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 17:55:15,147 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7 2023-07-11 17:55:15,148 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7 2023-07-11 17:55:15,151 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-07-11 17:55:15,152 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 0b68e8a6a3555cdd10a16d0303c35da7 2023-07-11 17:55:15,153 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 0b68e8a6a3555cdd10a16d0303c35da7; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58963188, jitterRate=-0.1213800311088562}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-07-11 17:55:15,153 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 0b68e8a6a3555cdd10a16d0303c35da7: 2023-07-11 17:55:15,154 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,,1689098094325.0b68e8a6a3555cdd10a16d0303c35da7., pid=101, masterSystemTime=1689098114846 2023-07-11 17:55:15,154 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-07-11 17:55:15,154 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=4), splitQueue=0 2023-07-11 17:55:15,156 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,,1689098094325.0b68e8a6a3555cdd10a16d0303c35da7. 2023-07-11 17:55:15,156 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,,1689098094325.0b68e8a6a3555cdd10a16d0303c35da7. 2023-07-11 17:55:15,156 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=98 updating hbase:meta row=0b68e8a6a3555cdd10a16d0303c35da7, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:15,156 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,,1689098094325.0b68e8a6a3555cdd10a16d0303c35da7.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1689098115156"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689098115156"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689098115156"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689098115156"}]},"ts":"1689098115156"} 2023-07-11 17:55:15,160 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=101, resume processing ppid=98 2023-07-11 17:55:15,160 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=98, state=SUCCESS; OpenRegionProcedure 0b68e8a6a3555cdd10a16d0303c35da7, server=jenkins-hbase9.apache.org,45839,1689097999112 in 464 msec 2023-07-11 17:55:15,161 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=98, resume processing ppid=97 2023-07-11 17:55:15,161 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=98, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=0b68e8a6a3555cdd10a16d0303c35da7, ASSIGN in 622 msec 2023-07-11 17:55:15,162 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689098115162"}]},"ts":"1689098115162"} 2023-07-11 17:55:15,163 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLED in hbase:meta 2023-07-11 17:55:15,164 INFO [PEWorker-3] procedure.EnableTableProcedure(310): Table 'testCompactionWithHFileLink' was successfully enabled. 2023-07-11 17:55:15,166 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; EnableTableProcedure table=testCompactionWithHFileLink in 640 msec 2023-07-11 17:55:15,640 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-07-11 17:55:15,640 INFO [Listener at localhost/43271] client.HBaseAdmin$TableFuture(3541): Operation: ENABLE, Table Name: default:testCompactionWithHFileLink, procId: 97 completed 2023-07-11 17:55:15,652 DEBUG [Listener at localhost/43271] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-07-11 17:55:15,659 DEBUG [Listener at localhost/43271] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-07-11 17:55:15,668 DEBUG [Listener at localhost/43271] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-07-11 17:55:15,669 DEBUG [Listener at localhost/43271] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-07-11 17:55:15,676 INFO [Listener at localhost/43271] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-07-11 17:55:15,690 INFO [Listener at localhost/43271] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 12 selected files, and 0 irrelevant files table 'testCompactionWithHFileLink' and column 'family1' 2023-07-11 17:55:15,690 INFO [Listener at localhost/43271] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testCompactionWithHFileLink' column='family1' 2023-07-11 17:55:15,691 DEBUG [Listener at localhost/43271] zookeeper.ReadOnlyZKClient(139): Connect 0x57fc0dea to 127.0.0.1:50702 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 17:55:15,695 DEBUG [Listener at localhost/43271] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@17568abb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 17:55:15,695 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230711 for table='testCompactionWithHFileLink' and column='family1' 2023-07-11 17:55:15,695 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20230711 for table='testCompactionWithHFileLink' and column='family1' 2023-07-11 17:55:15,695 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230711 for table='testCompactionWithHFileLink' and column='family1' 2023-07-11 17:55:16,177 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202307110a6fbc170bd5441389ef25489554aef9 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202307110a6fbc170bd5441389ef25489554aef9 2023-07-11 17:55:16,178 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230711 table='testCompactionWithHFileLink' column='family1' 2023-07-11 17:55:16,180 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230711f90cf5143f384f2e8f672c9a8f179bef to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230711f90cf5143f384f2e8f672c9a8f179bef 2023-07-11 17:55:16,181 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202307116191f557982642e4b1b94f1788ee993b to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202307116191f557982642e4b1b94f1788ee993b 2023-07-11 17:55:16,188 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230711 table='testCompactionWithHFileLink' column='family1' 2023-07-11 17:55:16,188 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230711 table='testCompactionWithHFileLink' column='family1' 2023-07-11 17:55:16,196 DEBUG [MobFileCompactionChore-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 17:55:16,202 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:50156, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 17:55:16,212 DEBUG [MobFileCompactionChore-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-11 17:55:16,215 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:41022, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-11 17:55:16,238 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230711/family1/13bab10f864742babe15a8d21737d598 first=Optional[2\x00\x00\x00\x00] last=Optional[2\x00\x00\x00\x07] 2023-07-11 17:55:16,239 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230711/family1/e5045dee93f545869776f98d03bd4b41 first=Optional[0\x00\x00\x00\x00] last=Optional[0\x00\x00\x00\x07] 2023-07-11 17:55:16,239 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230711/family1/b284ff416a834f30a834e730f1d7985f first=Optional[1\x00\x00\x00\x00] last=Optional[1\x00\x00\x00\x07] 2023-07-11 17:55:16,239 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,2,1689098094325.17aacf583da279539e944e5353cb4f95., hostname=jenkins-hbase9.apache.org,45839,1689097999112, seqNum=32 for row 2 with hfile group [{family1,hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230711/family1/13bab10f864742babe15a8d21737d598}] 2023-07-11 17:55:16,240 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,,1689098094325.0b68e8a6a3555cdd10a16d0303c35da7., hostname=jenkins-hbase9.apache.org,45839,1689097999112, seqNum=32 for row with hfile group [{family1,hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230711/family1/e5045dee93f545869776f98d03bd4b41}] 2023-07-11 17:55:16,240 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,1,1689098094325.c13bb432df8709c95734bd08b015997b., hostname=jenkins-hbase9.apache.org,45839,1689097999112, seqNum=32 for row 1 with hfile group [{family1,hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230711/family1/b284ff416a834f30a834e730f1d7985f}] 2023-07-11 17:55:16,259 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(763): Validating hfile at hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230711/family1/e5045dee93f545869776f98d03bd4b41 for inclusion in 0b68e8a6a3555cdd10a16d0303c35da7/family1 2023-07-11 17:55:16,259 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45839] regionserver.HStore(763): Validating hfile at hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230711/family1/13bab10f864742babe15a8d21737d598 for inclusion in 17aacf583da279539e944e5353cb4f95/family1 2023-07-11 17:55:16,259 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45839] regionserver.HStore(763): Validating hfile at hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230711/family1/b284ff416a834f30a834e730f1d7985f for inclusion in c13bb432df8709c95734bd08b015997b/family1 2023-07-11 17:55:16,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x00 last=0\x00\x00\x00\x07 2023-07-11 17:55:16,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(777): Region bounds: first= last=1 2023-07-11 17:55:16,264 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HRegion(2446): Flush status journal for 0b68e8a6a3555cdd10a16d0303c35da7: 2023-07-11 17:55:16,265 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230711/family1/e5045dee93f545869776f98d03bd4b41 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testCompactionWithHFileLink__oqavkravnnigkhouimeehhv63qumc8kj1cnucd82qolsnaj10ob7gq6qnkvrnscc/family1/e5045dee93f545869776f98d03bd4b41 2023-07-11 17:55:16,266 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45839] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x00 last=2\x00\x00\x00\x07 2023-07-11 17:55:16,266 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45839] regionserver.HStore(777): Region bounds: first=2 last= 2023-07-11 17:55:16,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45839] regionserver.HRegion(2446): Flush status journal for 17aacf583da279539e944e5353cb4f95: 2023-07-11 17:55:16,269 DEBUG [RS:0;jenkins-hbase9:45839-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/.tmp/family2/74720617e18c4a87bd152c28d6bcdcf4 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family2/74720617e18c4a87bd152c28d6bcdcf4 2023-07-11 17:55:16,270 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/.tmp/family1/677e5213d5774128915b00192c3129da as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family1/677e5213d5774128915b00192c3129da 2023-07-11 17:55:16,270 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45839] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230711/family1/13bab10f864742babe15a8d21737d598 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testCompactionWithHFileLink__fhicnvjnll2p18s3qrocmngsekpe4dmk43d0cuml61iovp28fo3indo9jchp084h/family1/13bab10f864742babe15a8d21737d598 2023-07-11 17:55:16,272 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45839] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x00 last=1\x00\x00\x00\x07 2023-07-11 17:55:16,273 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45839] regionserver.HStore(777): Region bounds: first=1 last=2 2023-07-11 17:55:16,273 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45839] regionserver.HRegion(2446): Flush status journal for c13bb432df8709c95734bd08b015997b: 2023-07-11 17:55:16,274 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45839] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testCompactionWithHFileLink__fhicnvjnll2p18s3qrocmngsekpe4dmk43d0cuml61iovp28fo3indo9jchp084h/family1/13bab10f864742babe15a8d21737d598 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family1/bbac1e6526374eadac54d9d8318d19d2_SeqId_34_ 2023-07-11 17:55:16,274 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45839] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230711/family1/b284ff416a834f30a834e730f1d7985f to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testCompactionWithHFileLink__oni2j7dn9ktmblksc445i534klvah2o1gs0aaome9hreaqdj7qr8e290uok75tp7/family1/b284ff416a834f30a834e730f1d7985f 2023-07-11 17:55:16,274 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45839] regionserver.HStore(849): Loaded HFile hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testCompactionWithHFileLink__fhicnvjnll2p18s3qrocmngsekpe4dmk43d0cuml61iovp28fo3indo9jchp084h/family1/13bab10f864742babe15a8d21737d598 into 17aacf583da279539e944e5353cb4f95/family1 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family1/bbac1e6526374eadac54d9d8318d19d2_SeqId_34_ - updating store file list. 2023-07-11 17:55:16,275 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testCompactionWithHFileLink__oqavkravnnigkhouimeehhv63qumc8kj1cnucd82qolsnaj10ob7gq6qnkvrnscc/family1/e5045dee93f545869776f98d03bd4b41 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family1/15f102d359454a189a85520618a3399f_SeqId_34_ 2023-07-11 17:55:16,277 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testCompactionWithHFileLink' 2023-07-11 17:55:16,278 INFO [RS:0;jenkins-hbase9:45839-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in c13bb432df8709c95734bd08b015997b/family1 of c13bb432df8709c95734bd08b015997b into 677e5213d5774128915b00192c3129da(size=7.6 K), total size for store is 7.6 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-07-11 17:55:16,278 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for c13bb432df8709c95734bd08b015997b: 2023-07-11 17:55:16,278 INFO [RS:0;jenkins-hbase9:45839-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,1,1689098094325.c13bb432df8709c95734bd08b015997b., storeName=c13bb432df8709c95734bd08b015997b/family1, priority=12, startTime=1689098114968; duration=1sec 2023-07-11 17:55:16,278 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=4), splitQueue=0 2023-07-11 17:55:16,278 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-07-11 17:55:16,279 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(849): Loaded HFile hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testCompactionWithHFileLink__oqavkravnnigkhouimeehhv63qumc8kj1cnucd82qolsnaj10ob7gq6qnkvrnscc/family1/e5045dee93f545869776f98d03bd4b41 into 0b68e8a6a3555cdd10a16d0303c35da7/family1 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family1/15f102d359454a189a85520618a3399f_SeqId_34_ - updating store file list. 2023-07-11 17:55:16,293 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 22152 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-07-11 17:55:16,293 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] regionserver.HStore(1912): 17aacf583da279539e944e5353cb4f95/family1 is initiating minor compaction (all files) 2023-07-11 17:55:16,293 INFO [RS:0;jenkins-hbase9:45839-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 17aacf583da279539e944e5353cb4f95/family1 in testCompactionWithHFileLink,2,1689098094325.17aacf583da279539e944e5353cb4f95. 2023-07-11 17:55:16,293 INFO [RS:0;jenkins-hbase9:45839-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family1/testCompactionWithHFileLink=17aacf583da279539e944e5353cb4f95-5a91189cc1db4a21b3f357d74add3143, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family1/testCompactionWithHFileLink=17aacf583da279539e944e5353cb4f95-e23b0c73b533452b95b0ad7a117cc636, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family1/testCompactionWithHFileLink=17aacf583da279539e944e5353cb4f95-c3c64e60ba094d8eb876fc9b98feec64, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family1/testCompactionWithHFileLink=17aacf583da279539e944e5353cb4f95-f9f5f943383c4935bf464d264c2e9f15] into tmpdir=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/.tmp, totalSize=21.6 K 2023-07-11 17:55:16,293 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45839] regionserver.HStore(882): Loaded HFile hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family1/bbac1e6526374eadac54d9d8318d19d2_SeqId_34_ into 17aacf583da279539e944e5353cb4f95/family1 2023-07-11 17:55:16,293 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(882): Loaded HFile hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family1/15f102d359454a189a85520618a3399f_SeqId_34_ into 0b68e8a6a3555cdd10a16d0303c35da7/family1 2023-07-11 17:55:16,293 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(855): Successfully loaded hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testCompactionWithHFileLink__oqavkravnnigkhouimeehhv63qumc8kj1cnucd82qolsnaj10ob7gq6qnkvrnscc/family1/e5045dee93f545869776f98d03bd4b41 into 0b68e8a6a3555cdd10a16d0303c35da7/family1 (new location: hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family1/15f102d359454a189a85520618a3399f_SeqId_34_) 2023-07-11 17:55:16,294 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45839] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testCompactionWithHFileLink__oni2j7dn9ktmblksc445i534klvah2o1gs0aaome9hreaqdj7qr8e290uok75tp7/family1/b284ff416a834f30a834e730f1d7985f as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family1/ce77a9fc1a514c3bad02c2bc72529272_SeqId_34_ 2023-07-11 17:55:16,293 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45839] regionserver.HStore(855): Successfully loaded hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testCompactionWithHFileLink__fhicnvjnll2p18s3qrocmngsekpe4dmk43d0cuml61iovp28fo3indo9jchp084h/family1/13bab10f864742babe15a8d21737d598 into 17aacf583da279539e944e5353cb4f95/family1 (new location: hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family1/bbac1e6526374eadac54d9d8318d19d2_SeqId_34_) 2023-07-11 17:55:16,294 INFO [RS:0;jenkins-hbase9:45839-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in c13bb432df8709c95734bd08b015997b/family2 of c13bb432df8709c95734bd08b015997b into 74720617e18c4a87bd152c28d6bcdcf4(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-07-11 17:55:16,294 DEBUG [RS:0;jenkins-hbase9:45839-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for c13bb432df8709c95734bd08b015997b: 2023-07-11 17:55:16,294 INFO [RS:0;jenkins-hbase9:45839-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,1,1689098094325.c13bb432df8709c95734bd08b015997b., storeName=c13bb432df8709c95734bd08b015997b/family2, priority=12, startTime=1689098114969; duration=1sec 2023-07-11 17:55:16,294 DEBUG [RS:0;jenkins-hbase9:45839-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-07-11 17:55:16,294 DEBUG [RS:0;jenkins-hbase9:45839-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-07-11 17:55:16,294 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45839] regionserver.HStore(849): Loaded HFile hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testCompactionWithHFileLink__oni2j7dn9ktmblksc445i534klvah2o1gs0aaome9hreaqdj7qr8e290uok75tp7/family1/b284ff416a834f30a834e730f1d7985f into c13bb432df8709c95734bd08b015997b/family1 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family1/ce77a9fc1a514c3bad02c2bc72529272_SeqId_34_ - updating store file list. 2023-07-11 17:55:16,295 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=17aacf583da279539e944e5353cb4f95-5a91189cc1db4a21b3f357d74add3143, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1689098096443 2023-07-11 17:55:16,295 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testCompactionWithHFileLink__oqavkravnnigkhouimeehhv63qumc8kj1cnucd82qolsnaj10ob7gq6qnkvrnscc/family1/e5045dee93f545869776f98d03bd4b41 2023-07-11 17:55:16,295 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-07-11 17:55:16,296 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=17aacf583da279539e944e5353cb4f95-e23b0c73b533452b95b0ad7a117cc636, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1689098098227 2023-07-11 17:55:16,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45839] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testCompactionWithHFileLink__fhicnvjnll2p18s3qrocmngsekpe4dmk43d0cuml61iovp28fo3indo9jchp084h/family1/13bab10f864742babe15a8d21737d598 2023-07-11 17:55:16,297 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=17aacf583da279539e944e5353cb4f95-c3c64e60ba094d8eb876fc9b98feec64, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1689098099619 2023-07-11 17:55:16,299 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=17aacf583da279539e944e5353cb4f95-f9f5f943383c4935bf464d264c2e9f15, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1689098101022 2023-07-11 17:55:16,299 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230711 table='testCompactionWithHFileLink' column='family1' 2023-07-11 17:55:16,300 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45839] regionserver.HStore(882): Loaded HFile hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family1/ce77a9fc1a514c3bad02c2bc72529272_SeqId_34_ into c13bb432df8709c95734bd08b015997b/family1 2023-07-11 17:55:16,300 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45839] regionserver.HStore(855): Successfully loaded hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testCompactionWithHFileLink__oni2j7dn9ktmblksc445i534klvah2o1gs0aaome9hreaqdj7qr8e290uok75tp7/family1/b284ff416a834f30a834e730f1d7985f into c13bb432df8709c95734bd08b015997b/family1 (new location: hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family1/ce77a9fc1a514c3bad02c2bc72529272_SeqId_34_) 2023-07-11 17:55:16,300 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 17:55:16,300 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45839] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testCompactionWithHFileLink__oni2j7dn9ktmblksc445i534klvah2o1gs0aaome9hreaqdj7qr8e290uok75tp7/family1/b284ff416a834f30a834e730f1d7985f 2023-07-11 17:55:16,301 DEBUG [RS:0;jenkins-hbase9:45839-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-07-11 17:55:16,301 DEBUG [RS:0;jenkins-hbase9:45839-longCompactions-0] regionserver.HStore(1912): 0b68e8a6a3555cdd10a16d0303c35da7/family2 is initiating minor compaction (all files) 2023-07-11 17:55:16,301 INFO [RS:0;jenkins-hbase9:45839-longCompactions-0] regionserver.HRegion(2259): Starting compaction of 0b68e8a6a3555cdd10a16d0303c35da7/family2 in testCompactionWithHFileLink,,1689098094325.0b68e8a6a3555cdd10a16d0303c35da7. 2023-07-11 17:55:16,301 INFO [RS:0;jenkins-hbase9:45839-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family2/testCompactionWithHFileLink=0b68e8a6a3555cdd10a16d0303c35da7-1f1fcd346abe4a0d82bc870270831a57, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family2/testCompactionWithHFileLink=0b68e8a6a3555cdd10a16d0303c35da7-2039c633aed54fb586721637ea9d9e6a, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family2/testCompactionWithHFileLink=0b68e8a6a3555cdd10a16d0303c35da7-f947d88b4b43450ea6febcd27f599a5b, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family2/testCompactionWithHFileLink=0b68e8a6a3555cdd10a16d0303c35da7-92122c7c52a6480298263dfb61d0b114] into tmpdir=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/.tmp, totalSize=20.4 K 2023-07-11 17:55:16,302 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 5 files of size 29606 starting at candidate #0 after considering 6 permutations with 6 in ratio 2023-07-11 17:55:16,302 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(1912): 0b68e8a6a3555cdd10a16d0303c35da7/family1 is initiating minor compaction (all files) 2023-07-11 17:55:16,302 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@fe98425; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-07-11 17:55:16,302 DEBUG [RS:0;jenkins-hbase9:45839-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=0b68e8a6a3555cdd10a16d0303c35da7-1f1fcd346abe4a0d82bc870270831a57, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1689098096440 2023-07-11 17:55:16,303 DEBUG [RS:0;jenkins-hbase9:45839-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=0b68e8a6a3555cdd10a16d0303c35da7-2039c633aed54fb586721637ea9d9e6a, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1689098098226 2023-07-11 17:55:16,304 DEBUG [RS:0;jenkins-hbase9:45839-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=0b68e8a6a3555cdd10a16d0303c35da7-f947d88b4b43450ea6febcd27f599a5b, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1689098099619 2023-07-11 17:55:16,304 DEBUG [RS:0;jenkins-hbase9:45839-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=0b68e8a6a3555cdd10a16d0303c35da7-92122c7c52a6480298263dfb61d0b114, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1689098101021 2023-07-11 17:55:16,308 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230711 table='testCompactionWithHFileLink' column='family1' 2023-07-11 17:55:16,308 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230711 table='testCompactionWithHFileLink' column='family1' 2023-07-11 17:55:16,308 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 17:55:16,309 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 17:55:16,309 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c2023071143ec884407d94c27940dfd59e222e6b1 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c2023071143ec884407d94c27940dfd59e222e6b1 2023-07-11 17:55:16,311 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202307111c8fb68fb458472e86510c786c76ca18 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202307111c8fb68fb458472e86510c786c76ca18 2023-07-11 17:55:16,311 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230711677457bc24104b5390bb726bdfdde12d to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230711677457bc24104b5390bb726bdfdde12d 2023-07-11 17:55:16,312 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230711424207b9ba6e4a258b0a8ebee407947b to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230711424207b9ba6e4a258b0a8ebee407947b 2023-07-11 17:55:16,313 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c2023071186b920a80822440fa11dc71ce5c2eda1 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c2023071186b920a80822440fa11dc71ce5c2eda1 2023-07-11 17:55:16,313 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b2023071159eb6543927c4caebe900be67b0dc8b1 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b2023071159eb6543927c4caebe900be67b0dc8b1 2023-07-11 17:55:16,314 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e2023071191aac97fa1dc4c54a45b2652468490a8 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e2023071191aac97fa1dc4c54a45b2652468490a8 2023-07-11 17:55:16,315 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230711aa14f34b4f9540efbcae4d44c4a026cb to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230711aa14f34b4f9540efbcae4d44c4a026cb 2023-07-11 17:55:16,315 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-07-11 17:55:16,315 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230711' 2023-07-11 17:55:16,315 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20230711b9209a6f661046c2bbf3ce8c223e422e to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20230711b9209a6f661046c2bbf3ce8c223e422e 2023-07-11 17:55:16,315 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230711c742cd6d9dd143229322deefe82e089f to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230711c742cd6d9dd143229322deefe82e089f 2023-07-11 17:55:16,316 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230711 for table='testCompactionWithHFileLink' and column='family1' 2023-07-11 17:55:16,317 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20230711dfdabf355e284e7791a42e28492c6e4b to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20230711dfdabf355e284e7791a42e28492c6e4b 2023-07-11 17:55:16,317 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-07-11 17:55:16,317 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230711' 2023-07-11 17:55:16,318 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230711d34c31dca08a4a3d87c90aae83c14ab8 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230711d34c31dca08a4a3d87c90aae83c14ab8 2023-07-11 17:55:16,318 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-07-11 17:55:16,318 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230711' 2023-07-11 17:55:16,318 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230711 for table='testCompactionWithHFileLink' and column='family1' 2023-07-11 17:55:16,318 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20230711 for table='testCompactionWithHFileLink' and column='family1' 2023-07-11 17:55:16,318 INFO [Listener at localhost/43271] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testCompactionWithHFileLink' column='family1' 2023-07-11 17:55:16,322 DEBUG [Listener at localhost/43271] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-07-11 17:55:16,329 DEBUG [Listener at localhost/43271] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-07-11 17:55:16,334 DEBUG [Listener at localhost/43271] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-07-11 17:55:16,335 DEBUG [Listener at localhost/43271] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-07-11 17:55:16,343 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family1/testCompactionWithHFileLink=c13bb432df8709c95734bd08b015997b-76b71e8b082a4db9a277c10783c7028f, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family1/testCompactionWithHFileLink=c13bb432df8709c95734bd08b015997b-30f4c31959d44a41b966543ef2a39e52, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family1/testCompactionWithHFileLink=c13bb432df8709c95734bd08b015997b-81e1f065bb5d4f5c8f55b71da3938881, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family1/testCompactionWithHFileLink=c13bb432df8709c95734bd08b015997b-4a50c361db254e91bf01d52a3e927bcd] to archive 2023-07-11 17:55:16,344 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 17:55:16,345 DEBUG [Listener at localhost/43271] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-07-11 17:55:16,348 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family1/testCompactionWithHFileLink=c13bb432df8709c95734bd08b015997b-76b71e8b082a4db9a277c10783c7028f to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family1/testCompactionWithHFileLink=c13bb432df8709c95734bd08b015997b-76b71e8b082a4db9a277c10783c7028f 2023-07-11 17:55:16,348 DEBUG [Listener at localhost/43271] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-07-11 17:55:16,350 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family1/testCompactionWithHFileLink=c13bb432df8709c95734bd08b015997b-30f4c31959d44a41b966543ef2a39e52 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family1/testCompactionWithHFileLink=c13bb432df8709c95734bd08b015997b-30f4c31959d44a41b966543ef2a39e52 2023-07-11 17:55:16,351 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family1/testCompactionWithHFileLink=c13bb432df8709c95734bd08b015997b-81e1f065bb5d4f5c8f55b71da3938881 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family1/testCompactionWithHFileLink=c13bb432df8709c95734bd08b015997b-81e1f065bb5d4f5c8f55b71da3938881 2023-07-11 17:55:16,355 INFO [RS:0;jenkins-hbase9:45839-shortCompactions-0] throttle.PressureAwareThroughputController(145): 17aacf583da279539e944e5353cb4f95#family1#compaction#115 average throughput is 0.09 MB/second, slept 0 time(s) and total slept time is 0 ms. 1 active operations remaining, total limit is 50.00 MB/second 2023-07-11 17:55:16,355 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family1/testCompactionWithHFileLink=c13bb432df8709c95734bd08b015997b-4a50c361db254e91bf01d52a3e927bcd to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family1/testCompactionWithHFileLink=c13bb432df8709c95734bd08b015997b-4a50c361db254e91bf01d52a3e927bcd 2023-07-11 17:55:16,357 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family2/testCompactionWithHFileLink=c13bb432df8709c95734bd08b015997b-02c2a20c070443429b770182c7743f19, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family2/testCompactionWithHFileLink=c13bb432df8709c95734bd08b015997b-53a30bd9c0034d4184a04d4074cea82d, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family2/testCompactionWithHFileLink=c13bb432df8709c95734bd08b015997b-4fd592c4b4f8466e88ff4f127c71d5ef, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family2/testCompactionWithHFileLink=c13bb432df8709c95734bd08b015997b-26f71c895e82431b9c24d88865e336be] to archive 2023-07-11 17:55:16,358 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 17:55:16,358 INFO [RS:0;jenkins-hbase9:45839-longCompactions-0] throttle.PressureAwareThroughputController(145): 0b68e8a6a3555cdd10a16d0303c35da7#family2#compaction#116 average throughput is 0.06 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-11 17:55:16,364 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family2/testCompactionWithHFileLink=c13bb432df8709c95734bd08b015997b-02c2a20c070443429b770182c7743f19 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family2/testCompactionWithHFileLink=c13bb432df8709c95734bd08b015997b-02c2a20c070443429b770182c7743f19 2023-07-11 17:55:16,365 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family2/testCompactionWithHFileLink=c13bb432df8709c95734bd08b015997b-53a30bd9c0034d4184a04d4074cea82d to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family2/testCompactionWithHFileLink=c13bb432df8709c95734bd08b015997b-53a30bd9c0034d4184a04d4074cea82d 2023-07-11 17:55:16,367 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family2/testCompactionWithHFileLink=c13bb432df8709c95734bd08b015997b-4fd592c4b4f8466e88ff4f127c71d5ef to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family2/testCompactionWithHFileLink=c13bb432df8709c95734bd08b015997b-4fd592c4b4f8466e88ff4f127c71d5ef 2023-07-11 17:55:16,372 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family2/testCompactionWithHFileLink=c13bb432df8709c95734bd08b015997b-26f71c895e82431b9c24d88865e336be to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/family2/testCompactionWithHFileLink=c13bb432df8709c95734bd08b015997b-26f71c895e82431b9c24d88865e336be 2023-07-11 17:55:16,379 INFO [Listener at localhost/43271] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testCompactionWithHFileLink Thread=289 (was 255) - Thread LEAK? -, OpenFileDescriptor=757 (was 650) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=271 (was 261) - SystemLoadAverage LEAK? -, ProcessCount=170 (was 170), AvailableMemoryMB=8505 (was 8341) - AvailableMemoryMB LEAK? - 2023-07-11 17:55:16,393 INFO [Listener at localhost/43271] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompaction Thread=292, OpenFileDescriptor=754, MaxFileDescriptor=60000, SystemLoadAverage=271, ProcessCount=170, AvailableMemoryMB=8505 2023-07-11 17:55:16,398 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.HMaster$15(3014): Client=jenkins//172.31.2.10 creating {NAME => 'ns'} 2023-07-11 17:55:16,399 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=ns 2023-07-11 17:55:16,404 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-11 17:55:16,405 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-11 17:55:16,411 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; CreateNamespaceProcedure, namespace=ns in 11 msec 2023-07-11 17:55:16,505 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-11 17:55:16,507 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-11 17:55:16,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=ns:testMinorCompaction 2023-07-11 17:55:16,510 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_PRE_OPERATION 2023-07-11 17:55:16,510 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "ns" qualifier: "testMinorCompaction" procId is: 105 2023-07-11 17:55:16,510 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-11 17:55:16,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-11 17:55:16,512 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/.tmp/data/ns/testMinorCompaction/03ba78e07b3026a36a7cde3865422d82 2023-07-11 17:55:16,513 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/.tmp/data/ns/testMinorCompaction/4e4357287b129f0600b33397cb2004ec 2023-07-11 17:55:16,513 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/.tmp/data/ns/testMinorCompaction/03ba78e07b3026a36a7cde3865422d82 empty. 2023-07-11 17:55:16,514 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/.tmp/data/ns/testMinorCompaction/32200e46ee32133355d305b07aa3b428 2023-07-11 17:55:16,514 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/.tmp/data/ns/testMinorCompaction/4e4357287b129f0600b33397cb2004ec empty. 2023-07-11 17:55:16,514 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/.tmp/data/ns/testMinorCompaction/03ba78e07b3026a36a7cde3865422d82 2023-07-11 17:55:16,514 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/.tmp/data/ns/testMinorCompaction/4e4357287b129f0600b33397cb2004ec 2023-07-11 17:55:16,514 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/.tmp/data/ns/testMinorCompaction/32200e46ee32133355d305b07aa3b428 empty. 2023-07-11 17:55:16,515 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/.tmp/data/ns/testMinorCompaction/32200e46ee32133355d305b07aa3b428 2023-07-11 17:55:16,515 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived ns:testMinorCompaction regions 2023-07-11 17:55:16,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-11 17:55:16,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-11 17:55:16,925 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/.tmp/data/ns/testMinorCompaction/.tabledesc/.tableinfo.0000000001 2023-07-11 17:55:16,927 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(7675): creating {ENCODED => 32200e46ee32133355d305b07aa3b428, NAME => 'ns:testMinorCompaction,2,1689098116506.32200e46ee32133355d305b07aa3b428.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/.tmp 2023-07-11 17:55:16,927 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(7675): creating {ENCODED => 4e4357287b129f0600b33397cb2004ec, NAME => 'ns:testMinorCompaction,1,1689098116506.4e4357287b129f0600b33397cb2004ec.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/.tmp 2023-07-11 17:55:16,927 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(7675): creating {ENCODED => 03ba78e07b3026a36a7cde3865422d82, NAME => 'ns:testMinorCompaction,,1689098116506.03ba78e07b3026a36a7cde3865422d82.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/.tmp 2023-07-11 17:55:16,949 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,,1689098116506.03ba78e07b3026a36a7cde3865422d82.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 17:55:16,949 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1604): Closing 03ba78e07b3026a36a7cde3865422d82, disabling compactions & flushes 2023-07-11 17:55:16,949 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,,1689098116506.03ba78e07b3026a36a7cde3865422d82. 2023-07-11 17:55:16,949 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,,1689098116506.03ba78e07b3026a36a7cde3865422d82. 2023-07-11 17:55:16,949 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,,1689098116506.03ba78e07b3026a36a7cde3865422d82. after waiting 0 ms 2023-07-11 17:55:16,949 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,,1689098116506.03ba78e07b3026a36a7cde3865422d82. 2023-07-11 17:55:16,949 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,,1689098116506.03ba78e07b3026a36a7cde3865422d82. 2023-07-11 17:55:16,949 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1558): Region close journal for 03ba78e07b3026a36a7cde3865422d82: 2023-07-11 17:55:17,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-11 17:55:17,191 DEBUG [RS:0;jenkins-hbase9:45839-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/.tmp/family2/c30b2ac0051849d1981ce989cb9e89da as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family2/c30b2ac0051849d1981ce989cb9e89da 2023-07-11 17:55:17,196 INFO [RS:0;jenkins-hbase9:45839-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 0b68e8a6a3555cdd10a16d0303c35da7/family2 of 0b68e8a6a3555cdd10a16d0303c35da7 into c30b2ac0051849d1981ce989cb9e89da(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-11 17:55:17,196 DEBUG [RS:0;jenkins-hbase9:45839-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for 0b68e8a6a3555cdd10a16d0303c35da7: 2023-07-11 17:55:17,196 INFO [RS:0;jenkins-hbase9:45839-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,,1689098094325.0b68e8a6a3555cdd10a16d0303c35da7., storeName=0b68e8a6a3555cdd10a16d0303c35da7/family2, priority=12, startTime=1689098115154; duration=0sec 2023-07-11 17:55:17,196 DEBUG [RS:0;jenkins-hbase9:45839-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-07-11 17:55:17,196 INFO [RS:0;jenkins-hbase9:45839-longCompactions-0] regionserver.HRegion(2259): Starting compaction of 0b68e8a6a3555cdd10a16d0303c35da7/family1 in testCompactionWithHFileLink,,1689098094325.0b68e8a6a3555cdd10a16d0303c35da7. 2023-07-11 17:55:17,196 INFO [RS:0;jenkins-hbase9:45839-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family1/testCompactionWithHFileLink=0b68e8a6a3555cdd10a16d0303c35da7-a707ff33e39949af81987160f0ba5530, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family1/testCompactionWithHFileLink=0b68e8a6a3555cdd10a16d0303c35da7-ba7bb4ba5b4b4f56bf5eb50df7f9ec97, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family1/testCompactionWithHFileLink=0b68e8a6a3555cdd10a16d0303c35da7-2ae88bcf87d84d07aad6592c3af1a04d, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family1/testCompactionWithHFileLink=0b68e8a6a3555cdd10a16d0303c35da7-573c26d7757245d6943f5d881e9bc774, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family1/15f102d359454a189a85520618a3399f_SeqId_34_] into tmpdir=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/.tmp, totalSize=28.9 K 2023-07-11 17:55:17,197 DEBUG [RS:0;jenkins-hbase9:45839-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=0b68e8a6a3555cdd10a16d0303c35da7-a707ff33e39949af81987160f0ba5530, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1689098096440 2023-07-11 17:55:17,198 DEBUG [RS:0;jenkins-hbase9:45839-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=0b68e8a6a3555cdd10a16d0303c35da7-ba7bb4ba5b4b4f56bf5eb50df7f9ec97, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1689098098226 2023-07-11 17:55:17,199 DEBUG [RS:0;jenkins-hbase9:45839-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=0b68e8a6a3555cdd10a16d0303c35da7-2ae88bcf87d84d07aad6592c3af1a04d, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1689098099619 2023-07-11 17:55:17,200 DEBUG [RS:0;jenkins-hbase9:45839-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=0b68e8a6a3555cdd10a16d0303c35da7-573c26d7757245d6943f5d881e9bc774, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1689098101021 2023-07-11 17:55:17,200 DEBUG [RS:0;jenkins-hbase9:45839-longCompactions-0] compactions.Compactor(207): Compacting 15f102d359454a189a85520618a3399f_SeqId_34_, keycount=16, bloomtype=ROW, size=7.3 K, encoding=NONE, compression=NONE, seqNum=35, earliestPutTs=1689098096440 2023-07-11 17:55:17,214 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/.tmp/family1/2824f58959af4d799bea1998c43e759d as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family1/2824f58959af4d799bea1998c43e759d 2023-07-11 17:55:17,219 INFO [RS:0;jenkins-hbase9:45839-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 17aacf583da279539e944e5353cb4f95/family1 of 17aacf583da279539e944e5353cb4f95 into 2824f58959af4d799bea1998c43e759d(size=7.6 K), total size for store is 14.9 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-11 17:55:17,220 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 17aacf583da279539e944e5353cb4f95: 2023-07-11 17:55:17,220 INFO [RS:0;jenkins-hbase9:45839-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,2,1689098094325.17aacf583da279539e944e5353cb4f95., storeName=17aacf583da279539e944e5353cb4f95/family1, priority=12, startTime=1689098115083; duration=0sec 2023-07-11 17:55:17,220 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=2), splitQueue=0 2023-07-11 17:55:17,220 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 5 compacting, 0 eligible, 16 blocking 2023-07-11 17:55:17,220 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-07-11 17:55:17,220 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-07-11 17:55:17,220 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] regionserver.CompactSplit(415): Not compacting testCompactionWithHFileLink,,1689098094325.0b68e8a6a3555cdd10a16d0303c35da7. because compaction request was cancelled 2023-07-11 17:55:17,220 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-07-11 17:55:17,223 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-07-11 17:55:17,223 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] regionserver.HStore(1912): 17aacf583da279539e944e5353cb4f95/family2 is initiating minor compaction (all files) 2023-07-11 17:55:17,224 INFO [RS:0;jenkins-hbase9:45839-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 17aacf583da279539e944e5353cb4f95/family2 in testCompactionWithHFileLink,2,1689098094325.17aacf583da279539e944e5353cb4f95. 2023-07-11 17:55:17,224 INFO [RS:0;jenkins-hbase9:45839-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family2/testCompactionWithHFileLink=17aacf583da279539e944e5353cb4f95-93d53e1b8309484aa3e0289e23d040ab, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family2/testCompactionWithHFileLink=17aacf583da279539e944e5353cb4f95-cccfc7c128044a978c31c85a74c6959a, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family2/testCompactionWithHFileLink=17aacf583da279539e944e5353cb4f95-4adc47622f2a4637b3b54cce04c04b6e, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family2/testCompactionWithHFileLink=17aacf583da279539e944e5353cb4f95-ebe0cbb7380846508944493a19164584] into tmpdir=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/.tmp, totalSize=20.4 K 2023-07-11 17:55:17,225 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=17aacf583da279539e944e5353cb4f95-93d53e1b8309484aa3e0289e23d040ab, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1689098096443 2023-07-11 17:55:17,225 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=17aacf583da279539e944e5353cb4f95-cccfc7c128044a978c31c85a74c6959a, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1689098098227 2023-07-11 17:55:17,226 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=17aacf583da279539e944e5353cb4f95-4adc47622f2a4637b3b54cce04c04b6e, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1689098099619 2023-07-11 17:55:17,227 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=17aacf583da279539e944e5353cb4f95-ebe0cbb7380846508944493a19164584, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1689098101022 2023-07-11 17:55:17,227 INFO [RS:0;jenkins-hbase9:45839-longCompactions-0] throttle.PressureAwareThroughputController(145): 0b68e8a6a3555cdd10a16d0303c35da7#family1#compaction#117 average throughput is 1.17 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-11 17:55:17,246 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family1/testCompactionWithHFileLink=17aacf583da279539e944e5353cb4f95-5a91189cc1db4a21b3f357d74add3143, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family1/testCompactionWithHFileLink=17aacf583da279539e944e5353cb4f95-e23b0c73b533452b95b0ad7a117cc636, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family1/testCompactionWithHFileLink=17aacf583da279539e944e5353cb4f95-c3c64e60ba094d8eb876fc9b98feec64, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family1/testCompactionWithHFileLink=17aacf583da279539e944e5353cb4f95-f9f5f943383c4935bf464d264c2e9f15] to archive 2023-07-11 17:55:17,246 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 17:55:17,248 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family1/testCompactionWithHFileLink=17aacf583da279539e944e5353cb4f95-5a91189cc1db4a21b3f357d74add3143 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family1/testCompactionWithHFileLink=17aacf583da279539e944e5353cb4f95-5a91189cc1db4a21b3f357d74add3143 2023-07-11 17:55:17,249 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family1/testCompactionWithHFileLink=17aacf583da279539e944e5353cb4f95-e23b0c73b533452b95b0ad7a117cc636 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family1/testCompactionWithHFileLink=17aacf583da279539e944e5353cb4f95-e23b0c73b533452b95b0ad7a117cc636 2023-07-11 17:55:17,251 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family1/testCompactionWithHFileLink=17aacf583da279539e944e5353cb4f95-c3c64e60ba094d8eb876fc9b98feec64 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family1/testCompactionWithHFileLink=17aacf583da279539e944e5353cb4f95-c3c64e60ba094d8eb876fc9b98feec64 2023-07-11 17:55:17,252 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family1/testCompactionWithHFileLink=17aacf583da279539e944e5353cb4f95-f9f5f943383c4935bf464d264c2e9f15 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family1/testCompactionWithHFileLink=17aacf583da279539e944e5353cb4f95-f9f5f943383c4935bf464d264c2e9f15 2023-07-11 17:55:17,254 INFO [RS:0;jenkins-hbase9:45839-shortCompactions-0] throttle.PressureAwareThroughputController(145): 17aacf583da279539e944e5353cb4f95#family2#compaction#118 average throughput is 0.08 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-11 17:55:17,254 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family2/testCompactionWithHFileLink=0b68e8a6a3555cdd10a16d0303c35da7-1f1fcd346abe4a0d82bc870270831a57, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family2/testCompactionWithHFileLink=0b68e8a6a3555cdd10a16d0303c35da7-2039c633aed54fb586721637ea9d9e6a, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family2/testCompactionWithHFileLink=0b68e8a6a3555cdd10a16d0303c35da7-f947d88b4b43450ea6febcd27f599a5b, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family2/testCompactionWithHFileLink=0b68e8a6a3555cdd10a16d0303c35da7-92122c7c52a6480298263dfb61d0b114] to archive 2023-07-11 17:55:17,255 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 17:55:17,257 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family2/testCompactionWithHFileLink=0b68e8a6a3555cdd10a16d0303c35da7-1f1fcd346abe4a0d82bc870270831a57 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family2/testCompactionWithHFileLink=0b68e8a6a3555cdd10a16d0303c35da7-1f1fcd346abe4a0d82bc870270831a57 2023-07-11 17:55:17,259 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family2/testCompactionWithHFileLink=0b68e8a6a3555cdd10a16d0303c35da7-2039c633aed54fb586721637ea9d9e6a to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family2/testCompactionWithHFileLink=0b68e8a6a3555cdd10a16d0303c35da7-2039c633aed54fb586721637ea9d9e6a 2023-07-11 17:55:17,261 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family2/testCompactionWithHFileLink=0b68e8a6a3555cdd10a16d0303c35da7-f947d88b4b43450ea6febcd27f599a5b to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family2/testCompactionWithHFileLink=0b68e8a6a3555cdd10a16d0303c35da7-f947d88b4b43450ea6febcd27f599a5b 2023-07-11 17:55:17,264 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family2/testCompactionWithHFileLink=0b68e8a6a3555cdd10a16d0303c35da7-92122c7c52a6480298263dfb61d0b114 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family2/testCompactionWithHFileLink=0b68e8a6a3555cdd10a16d0303c35da7-92122c7c52a6480298263dfb61d0b114 2023-07-11 17:55:17,344 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,1,1689098116506.4e4357287b129f0600b33397cb2004ec.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 17:55:17,344 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,2,1689098116506.32200e46ee32133355d305b07aa3b428.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 17:55:17,344 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1604): Closing 4e4357287b129f0600b33397cb2004ec, disabling compactions & flushes 2023-07-11 17:55:17,344 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1604): Closing 32200e46ee32133355d305b07aa3b428, disabling compactions & flushes 2023-07-11 17:55:17,344 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,1,1689098116506.4e4357287b129f0600b33397cb2004ec. 2023-07-11 17:55:17,344 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,2,1689098116506.32200e46ee32133355d305b07aa3b428. 2023-07-11 17:55:17,344 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,2,1689098116506.32200e46ee32133355d305b07aa3b428. 2023-07-11 17:55:17,344 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,1,1689098116506.4e4357287b129f0600b33397cb2004ec. 2023-07-11 17:55:17,345 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,2,1689098116506.32200e46ee32133355d305b07aa3b428. after waiting 1 ms 2023-07-11 17:55:17,345 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,1,1689098116506.4e4357287b129f0600b33397cb2004ec. after waiting 0 ms 2023-07-11 17:55:17,345 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,2,1689098116506.32200e46ee32133355d305b07aa3b428. 2023-07-11 17:55:17,345 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,1,1689098116506.4e4357287b129f0600b33397cb2004ec. 2023-07-11 17:55:17,345 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1838): Closed ns:testMinorCompaction,2,1689098116506.32200e46ee32133355d305b07aa3b428. 2023-07-11 17:55:17,345 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1838): Closed ns:testMinorCompaction,1,1689098116506.4e4357287b129f0600b33397cb2004ec. 2023-07-11 17:55:17,345 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1558): Region close journal for 32200e46ee32133355d305b07aa3b428: 2023-07-11 17:55:17,345 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1558): Region close journal for 4e4357287b129f0600b33397cb2004ec: 2023-07-11 17:55:17,347 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_ADD_TO_META 2023-07-11 17:55:17,348 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,,1689098116506.03ba78e07b3026a36a7cde3865422d82.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1689098117348"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689098117348"}]},"ts":"1689098117348"} 2023-07-11 17:55:17,348 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,2,1689098116506.32200e46ee32133355d305b07aa3b428.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1689098117348"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689098117348"}]},"ts":"1689098117348"} 2023-07-11 17:55:17,348 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,1,1689098116506.4e4357287b129f0600b33397cb2004ec.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1689098117348"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689098117348"}]},"ts":"1689098117348"} 2023-07-11 17:55:17,350 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-07-11 17:55:17,351 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-11 17:55:17,351 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"ns:testMinorCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689098117351"}]},"ts":"1689098117351"} 2023-07-11 17:55:17,352 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=ns:testMinorCompaction, state=ENABLING in hbase:meta 2023-07-11 17:55:17,355 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=03ba78e07b3026a36a7cde3865422d82, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=4e4357287b129f0600b33397cb2004ec, ASSIGN}, {pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=32200e46ee32133355d305b07aa3b428, ASSIGN}] 2023-07-11 17:55:17,356 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=32200e46ee32133355d305b07aa3b428, ASSIGN 2023-07-11 17:55:17,357 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=4e4357287b129f0600b33397cb2004ec, ASSIGN 2023-07-11 17:55:17,357 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=03ba78e07b3026a36a7cde3865422d82, ASSIGN 2023-07-11 17:55:17,357 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=32200e46ee32133355d305b07aa3b428, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,45839,1689097999112; forceNewPlan=false, retain=false 2023-07-11 17:55:17,357 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=03ba78e07b3026a36a7cde3865422d82, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,45839,1689097999112; forceNewPlan=false, retain=false 2023-07-11 17:55:17,357 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=4e4357287b129f0600b33397cb2004ec, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,45839,1689097999112; forceNewPlan=false, retain=false 2023-07-11 17:55:17,509 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=03ba78e07b3026a36a7cde3865422d82, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:17,509 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=4e4357287b129f0600b33397cb2004ec, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:17,509 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=108 updating hbase:meta row=32200e46ee32133355d305b07aa3b428, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:17,510 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,1,1689098116506.4e4357287b129f0600b33397cb2004ec.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1689098117509"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689098117509"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689098117509"}]},"ts":"1689098117509"} 2023-07-11 17:55:17,510 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,2,1689098116506.32200e46ee32133355d305b07aa3b428.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1689098117509"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689098117509"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689098117509"}]},"ts":"1689098117509"} 2023-07-11 17:55:17,510 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,,1689098116506.03ba78e07b3026a36a7cde3865422d82.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1689098117509"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689098117509"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689098117509"}]},"ts":"1689098117509"} 2023-07-11 17:55:17,511 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=107, state=RUNNABLE; OpenRegionProcedure 4e4357287b129f0600b33397cb2004ec, server=jenkins-hbase9.apache.org,45839,1689097999112}] 2023-07-11 17:55:17,512 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=110, ppid=108, state=RUNNABLE; OpenRegionProcedure 32200e46ee32133355d305b07aa3b428, server=jenkins-hbase9.apache.org,45839,1689097999112}] 2023-07-11 17:55:17,512 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=111, ppid=106, state=RUNNABLE; OpenRegionProcedure 03ba78e07b3026a36a7cde3865422d82, server=jenkins-hbase9.apache.org,45839,1689097999112}] 2023-07-11 17:55:17,615 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-11 17:55:17,666 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open ns:testMinorCompaction,1,1689098116506.4e4357287b129f0600b33397cb2004ec. 2023-07-11 17:55:17,666 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4e4357287b129f0600b33397cb2004ec, NAME => 'ns:testMinorCompaction,1,1689098116506.4e4357287b129f0600b33397cb2004ec.', STARTKEY => '1', ENDKEY => '2'} 2023-07-11 17:55:17,666 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction 4e4357287b129f0600b33397cb2004ec 2023-07-11 17:55:17,666 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,1,1689098116506.4e4357287b129f0600b33397cb2004ec.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 17:55:17,666 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 4e4357287b129f0600b33397cb2004ec 2023-07-11 17:55:17,666 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 4e4357287b129f0600b33397cb2004ec 2023-07-11 17:55:17,668 INFO [StoreOpener-4e4357287b129f0600b33397cb2004ec-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 4e4357287b129f0600b33397cb2004ec 2023-07-11 17:55:17,670 DEBUG [StoreOpener-4e4357287b129f0600b33397cb2004ec-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/4e4357287b129f0600b33397cb2004ec/family1 2023-07-11 17:55:17,670 DEBUG [StoreOpener-4e4357287b129f0600b33397cb2004ec-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/4e4357287b129f0600b33397cb2004ec/family1 2023-07-11 17:55:17,670 INFO [StoreOpener-4e4357287b129f0600b33397cb2004ec-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4e4357287b129f0600b33397cb2004ec columnFamilyName family1 2023-07-11 17:55:17,672 INFO [StoreOpener-4e4357287b129f0600b33397cb2004ec-1] regionserver.HStore(310): Store=4e4357287b129f0600b33397cb2004ec/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 17:55:17,672 INFO [StoreOpener-4e4357287b129f0600b33397cb2004ec-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 4e4357287b129f0600b33397cb2004ec 2023-07-11 17:55:17,674 DEBUG [StoreOpener-4e4357287b129f0600b33397cb2004ec-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/4e4357287b129f0600b33397cb2004ec/family2 2023-07-11 17:55:17,674 DEBUG [StoreOpener-4e4357287b129f0600b33397cb2004ec-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/4e4357287b129f0600b33397cb2004ec/family2 2023-07-11 17:55:17,674 INFO [StoreOpener-4e4357287b129f0600b33397cb2004ec-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4e4357287b129f0600b33397cb2004ec columnFamilyName family2 2023-07-11 17:55:17,676 INFO [StoreOpener-4e4357287b129f0600b33397cb2004ec-1] regionserver.HStore(310): Store=4e4357287b129f0600b33397cb2004ec/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 17:55:17,676 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/.tmp/family2/3ed0073bbba14b40a85bdbf77e125dab as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family2/3ed0073bbba14b40a85bdbf77e125dab 2023-07-11 17:55:17,677 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/4e4357287b129f0600b33397cb2004ec 2023-07-11 17:55:17,678 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/4e4357287b129f0600b33397cb2004ec 2023-07-11 17:55:17,681 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-07-11 17:55:17,682 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 4e4357287b129f0600b33397cb2004ec 2023-07-11 17:55:17,684 INFO [RS:0;jenkins-hbase9:45839-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 17aacf583da279539e944e5353cb4f95/family2 of 17aacf583da279539e944e5353cb4f95 into 3ed0073bbba14b40a85bdbf77e125dab(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-11 17:55:17,684 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 17aacf583da279539e944e5353cb4f95: 2023-07-11 17:55:17,684 INFO [RS:0;jenkins-hbase9:45839-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,2,1689098094325.17aacf583da279539e944e5353cb4f95., storeName=17aacf583da279539e944e5353cb4f95/family2, priority=12, startTime=1689098115083; duration=0sec 2023-07-11 17:55:17,684 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-11 17:55:17,685 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/4e4357287b129f0600b33397cb2004ec/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 17:55:17,686 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 4e4357287b129f0600b33397cb2004ec; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70806455, jitterRate=0.05509839951992035}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-07-11 17:55:17,686 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 4e4357287b129f0600b33397cb2004ec: 2023-07-11 17:55:17,687 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for ns:testMinorCompaction,1,1689098116506.4e4357287b129f0600b33397cb2004ec., pid=109, masterSystemTime=1689098117663 2023-07-11 17:55:17,689 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for ns:testMinorCompaction,1,1689098116506.4e4357287b129f0600b33397cb2004ec. 2023-07-11 17:55:17,689 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened ns:testMinorCompaction,1,1689098116506.4e4357287b129f0600b33397cb2004ec. 2023-07-11 17:55:17,689 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open ns:testMinorCompaction,,1689098116506.03ba78e07b3026a36a7cde3865422d82. 2023-07-11 17:55:17,689 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 03ba78e07b3026a36a7cde3865422d82, NAME => 'ns:testMinorCompaction,,1689098116506.03ba78e07b3026a36a7cde3865422d82.', STARTKEY => '', ENDKEY => '1'} 2023-07-11 17:55:17,689 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=4e4357287b129f0600b33397cb2004ec, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:17,689 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction 03ba78e07b3026a36a7cde3865422d82 2023-07-11 17:55:17,689 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,1,1689098116506.4e4357287b129f0600b33397cb2004ec.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1689098117689"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689098117689"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689098117689"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689098117689"}]},"ts":"1689098117689"} 2023-07-11 17:55:17,690 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,,1689098116506.03ba78e07b3026a36a7cde3865422d82.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 17:55:17,690 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 03ba78e07b3026a36a7cde3865422d82 2023-07-11 17:55:17,690 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 03ba78e07b3026a36a7cde3865422d82 2023-07-11 17:55:17,693 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=107 2023-07-11 17:55:17,693 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=107, state=SUCCESS; OpenRegionProcedure 4e4357287b129f0600b33397cb2004ec, server=jenkins-hbase9.apache.org,45839,1689097999112 in 180 msec 2023-07-11 17:55:17,694 INFO [StoreOpener-03ba78e07b3026a36a7cde3865422d82-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 03ba78e07b3026a36a7cde3865422d82 2023-07-11 17:55:17,694 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=4e4357287b129f0600b33397cb2004ec, ASSIGN in 338 msec 2023-07-11 17:55:17,697 DEBUG [StoreOpener-03ba78e07b3026a36a7cde3865422d82-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/03ba78e07b3026a36a7cde3865422d82/family1 2023-07-11 17:55:17,697 DEBUG [StoreOpener-03ba78e07b3026a36a7cde3865422d82-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/03ba78e07b3026a36a7cde3865422d82/family1 2023-07-11 17:55:17,698 INFO [StoreOpener-03ba78e07b3026a36a7cde3865422d82-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 03ba78e07b3026a36a7cde3865422d82 columnFamilyName family1 2023-07-11 17:55:17,699 INFO [StoreOpener-03ba78e07b3026a36a7cde3865422d82-1] regionserver.HStore(310): Store=03ba78e07b3026a36a7cde3865422d82/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 17:55:17,699 INFO [StoreOpener-03ba78e07b3026a36a7cde3865422d82-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 03ba78e07b3026a36a7cde3865422d82 2023-07-11 17:55:17,701 DEBUG [StoreOpener-03ba78e07b3026a36a7cde3865422d82-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/03ba78e07b3026a36a7cde3865422d82/family2 2023-07-11 17:55:17,702 DEBUG [StoreOpener-03ba78e07b3026a36a7cde3865422d82-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/03ba78e07b3026a36a7cde3865422d82/family2 2023-07-11 17:55:17,702 INFO [StoreOpener-03ba78e07b3026a36a7cde3865422d82-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 03ba78e07b3026a36a7cde3865422d82 columnFamilyName family2 2023-07-11 17:55:17,703 INFO [StoreOpener-03ba78e07b3026a36a7cde3865422d82-1] regionserver.HStore(310): Store=03ba78e07b3026a36a7cde3865422d82/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 17:55:17,704 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/03ba78e07b3026a36a7cde3865422d82 2023-07-11 17:55:17,704 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/03ba78e07b3026a36a7cde3865422d82 2023-07-11 17:55:17,706 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-07-11 17:55:17,707 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 03ba78e07b3026a36a7cde3865422d82 2023-07-11 17:55:17,709 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/03ba78e07b3026a36a7cde3865422d82/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 17:55:17,709 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 03ba78e07b3026a36a7cde3865422d82; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63498616, jitterRate=-0.05379688739776611}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-07-11 17:55:17,709 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 03ba78e07b3026a36a7cde3865422d82: 2023-07-11 17:55:17,710 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for ns:testMinorCompaction,,1689098116506.03ba78e07b3026a36a7cde3865422d82., pid=111, masterSystemTime=1689098117663 2023-07-11 17:55:17,711 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for ns:testMinorCompaction,,1689098116506.03ba78e07b3026a36a7cde3865422d82. 2023-07-11 17:55:17,711 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened ns:testMinorCompaction,,1689098116506.03ba78e07b3026a36a7cde3865422d82. 2023-07-11 17:55:17,711 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open ns:testMinorCompaction,2,1689098116506.32200e46ee32133355d305b07aa3b428. 2023-07-11 17:55:17,711 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 32200e46ee32133355d305b07aa3b428, NAME => 'ns:testMinorCompaction,2,1689098116506.32200e46ee32133355d305b07aa3b428.', STARTKEY => '2', ENDKEY => ''} 2023-07-11 17:55:17,712 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction 32200e46ee32133355d305b07aa3b428 2023-07-11 17:55:17,712 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,2,1689098116506.32200e46ee32133355d305b07aa3b428.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 17:55:17,712 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 32200e46ee32133355d305b07aa3b428 2023-07-11 17:55:17,712 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 32200e46ee32133355d305b07aa3b428 2023-07-11 17:55:17,712 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=03ba78e07b3026a36a7cde3865422d82, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:17,712 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,,1689098116506.03ba78e07b3026a36a7cde3865422d82.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1689098117712"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689098117712"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689098117712"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689098117712"}]},"ts":"1689098117712"} 2023-07-11 17:55:17,713 INFO [StoreOpener-32200e46ee32133355d305b07aa3b428-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 32200e46ee32133355d305b07aa3b428 2023-07-11 17:55:17,714 DEBUG [StoreOpener-32200e46ee32133355d305b07aa3b428-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/32200e46ee32133355d305b07aa3b428/family1 2023-07-11 17:55:17,714 DEBUG [StoreOpener-32200e46ee32133355d305b07aa3b428-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/32200e46ee32133355d305b07aa3b428/family1 2023-07-11 17:55:17,715 INFO [StoreOpener-32200e46ee32133355d305b07aa3b428-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 32200e46ee32133355d305b07aa3b428 columnFamilyName family1 2023-07-11 17:55:17,715 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=111, resume processing ppid=106 2023-07-11 17:55:17,715 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=111, ppid=106, state=SUCCESS; OpenRegionProcedure 03ba78e07b3026a36a7cde3865422d82, server=jenkins-hbase9.apache.org,45839,1689097999112 in 202 msec 2023-07-11 17:55:17,716 INFO [StoreOpener-32200e46ee32133355d305b07aa3b428-1] regionserver.HStore(310): Store=32200e46ee32133355d305b07aa3b428/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 17:55:17,716 INFO [StoreOpener-32200e46ee32133355d305b07aa3b428-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 32200e46ee32133355d305b07aa3b428 2023-07-11 17:55:17,716 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=03ba78e07b3026a36a7cde3865422d82, ASSIGN in 360 msec 2023-07-11 17:55:17,717 DEBUG [StoreOpener-32200e46ee32133355d305b07aa3b428-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/32200e46ee32133355d305b07aa3b428/family2 2023-07-11 17:55:17,717 DEBUG [StoreOpener-32200e46ee32133355d305b07aa3b428-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/32200e46ee32133355d305b07aa3b428/family2 2023-07-11 17:55:17,717 INFO [StoreOpener-32200e46ee32133355d305b07aa3b428-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 32200e46ee32133355d305b07aa3b428 columnFamilyName family2 2023-07-11 17:55:17,718 INFO [StoreOpener-32200e46ee32133355d305b07aa3b428-1] regionserver.HStore(310): Store=32200e46ee32133355d305b07aa3b428/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 17:55:17,719 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/32200e46ee32133355d305b07aa3b428 2023-07-11 17:55:17,719 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/32200e46ee32133355d305b07aa3b428 2023-07-11 17:55:17,721 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-07-11 17:55:17,722 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 32200e46ee32133355d305b07aa3b428 2023-07-11 17:55:17,723 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/32200e46ee32133355d305b07aa3b428/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 17:55:17,724 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 32200e46ee32133355d305b07aa3b428; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75356333, jitterRate=0.12289686501026154}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-07-11 17:55:17,724 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 32200e46ee32133355d305b07aa3b428: 2023-07-11 17:55:17,724 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for ns:testMinorCompaction,2,1689098116506.32200e46ee32133355d305b07aa3b428., pid=110, masterSystemTime=1689098117663 2023-07-11 17:55:17,725 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for ns:testMinorCompaction,2,1689098116506.32200e46ee32133355d305b07aa3b428. 2023-07-11 17:55:17,725 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened ns:testMinorCompaction,2,1689098116506.32200e46ee32133355d305b07aa3b428. 2023-07-11 17:55:17,726 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=108 updating hbase:meta row=32200e46ee32133355d305b07aa3b428, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:17,726 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,2,1689098116506.32200e46ee32133355d305b07aa3b428.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1689098117726"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689098117726"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689098117726"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689098117726"}]},"ts":"1689098117726"} 2023-07-11 17:55:17,728 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=110, resume processing ppid=108 2023-07-11 17:55:17,728 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=110, ppid=108, state=SUCCESS; OpenRegionProcedure 32200e46ee32133355d305b07aa3b428, server=jenkins-hbase9.apache.org,45839,1689097999112 in 215 msec 2023-07-11 17:55:17,729 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=108, resume processing ppid=105 2023-07-11 17:55:17,729 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=32200e46ee32133355d305b07aa3b428, ASSIGN in 373 msec 2023-07-11 17:55:17,730 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-11 17:55:17,730 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"ns:testMinorCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689098117730"}]},"ts":"1689098117730"} 2023-07-11 17:55:17,731 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=ns:testMinorCompaction, state=ENABLED in hbase:meta 2023-07-11 17:55:17,734 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_POST_OPERATION 2023-07-11 17:55:17,735 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=ns:testMinorCompaction in 1.2270 sec 2023-07-11 17:55:17,736 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family2/testCompactionWithHFileLink=17aacf583da279539e944e5353cb4f95-93d53e1b8309484aa3e0289e23d040ab, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family2/testCompactionWithHFileLink=17aacf583da279539e944e5353cb4f95-cccfc7c128044a978c31c85a74c6959a, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family2/testCompactionWithHFileLink=17aacf583da279539e944e5353cb4f95-4adc47622f2a4637b3b54cce04c04b6e, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family2/testCompactionWithHFileLink=17aacf583da279539e944e5353cb4f95-ebe0cbb7380846508944493a19164584] to archive 2023-07-11 17:55:17,737 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 17:55:17,739 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family2/testCompactionWithHFileLink=17aacf583da279539e944e5353cb4f95-93d53e1b8309484aa3e0289e23d040ab to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family2/testCompactionWithHFileLink=17aacf583da279539e944e5353cb4f95-93d53e1b8309484aa3e0289e23d040ab 2023-07-11 17:55:17,740 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family2/testCompactionWithHFileLink=17aacf583da279539e944e5353cb4f95-cccfc7c128044a978c31c85a74c6959a to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family2/testCompactionWithHFileLink=17aacf583da279539e944e5353cb4f95-cccfc7c128044a978c31c85a74c6959a 2023-07-11 17:55:17,742 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family2/testCompactionWithHFileLink=17aacf583da279539e944e5353cb4f95-4adc47622f2a4637b3b54cce04c04b6e to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family2/testCompactionWithHFileLink=17aacf583da279539e944e5353cb4f95-4adc47622f2a4637b3b54cce04c04b6e 2023-07-11 17:55:17,743 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family2/testCompactionWithHFileLink=17aacf583da279539e944e5353cb4f95-ebe0cbb7380846508944493a19164584 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/family2/testCompactionWithHFileLink=17aacf583da279539e944e5353cb4f95-ebe0cbb7380846508944493a19164584 2023-07-11 17:55:18,108 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-07-11 17:55:18,453 DEBUG [RS:0;jenkins-hbase9:45839-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/.tmp/family1/a76ee32e1b134c1d9aeb87db1b3369e2 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family1/a76ee32e1b134c1d9aeb87db1b3369e2 2023-07-11 17:55:18,460 INFO [RS:0;jenkins-hbase9:45839-longCompactions-0] regionserver.HStore(1652): Completed compaction of 5 (all) file(s) in 0b68e8a6a3555cdd10a16d0303c35da7/family1 of 0b68e8a6a3555cdd10a16d0303c35da7 into a76ee32e1b134c1d9aeb87db1b3369e2(size=7.6 K), total size for store is 7.6 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-07-11 17:55:18,460 DEBUG [RS:0;jenkins-hbase9:45839-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for 0b68e8a6a3555cdd10a16d0303c35da7: 2023-07-11 17:55:18,460 INFO [RS:0;jenkins-hbase9:45839-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testCompactionWithHFileLink,,1689098094325.0b68e8a6a3555cdd10a16d0303c35da7., storeName=family1, fileCount=5, fileSize=28.9 K (5.4 K, 5.4 K, 5.4 K, 5.4 K, 7.3 K), priority=2, time=1689098116302; duration=1sec 2023-07-11 17:55:18,460 DEBUG [RS:0;jenkins-hbase9:45839-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-11 17:55:18,542 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family1/testCompactionWithHFileLink=0b68e8a6a3555cdd10a16d0303c35da7-a707ff33e39949af81987160f0ba5530, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family1/testCompactionWithHFileLink=0b68e8a6a3555cdd10a16d0303c35da7-ba7bb4ba5b4b4f56bf5eb50df7f9ec97, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family1/testCompactionWithHFileLink=0b68e8a6a3555cdd10a16d0303c35da7-2ae88bcf87d84d07aad6592c3af1a04d, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family1/testCompactionWithHFileLink=0b68e8a6a3555cdd10a16d0303c35da7-573c26d7757245d6943f5d881e9bc774, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family1/15f102d359454a189a85520618a3399f_SeqId_34_] to archive 2023-07-11 17:55:18,542 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 17:55:18,544 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family1/testCompactionWithHFileLink=0b68e8a6a3555cdd10a16d0303c35da7-a707ff33e39949af81987160f0ba5530 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family1/testCompactionWithHFileLink=0b68e8a6a3555cdd10a16d0303c35da7-a707ff33e39949af81987160f0ba5530 2023-07-11 17:55:18,545 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family1/testCompactionWithHFileLink=0b68e8a6a3555cdd10a16d0303c35da7-ba7bb4ba5b4b4f56bf5eb50df7f9ec97 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family1/testCompactionWithHFileLink=0b68e8a6a3555cdd10a16d0303c35da7-ba7bb4ba5b4b4f56bf5eb50df7f9ec97 2023-07-11 17:55:18,547 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family1/testCompactionWithHFileLink=0b68e8a6a3555cdd10a16d0303c35da7-2ae88bcf87d84d07aad6592c3af1a04d to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family1/testCompactionWithHFileLink=0b68e8a6a3555cdd10a16d0303c35da7-2ae88bcf87d84d07aad6592c3af1a04d 2023-07-11 17:55:18,548 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family1/testCompactionWithHFileLink=0b68e8a6a3555cdd10a16d0303c35da7-573c26d7757245d6943f5d881e9bc774 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family1/testCompactionWithHFileLink=0b68e8a6a3555cdd10a16d0303c35da7-573c26d7757245d6943f5d881e9bc774 2023-07-11 17:55:18,549 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family1/15f102d359454a189a85520618a3399f_SeqId_34_ to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/family1/15f102d359454a189a85520618a3399f_SeqId_34_ 2023-07-11 17:55:18,616 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-11 17:55:18,617 INFO [Listener at localhost/43271] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: ns:testMinorCompaction, procId: 105 completed 2023-07-11 17:55:18,633 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45839] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1689098116506.03ba78e07b3026a36a7cde3865422d82. with WAL disabled. Data may be lost in the event of a crash. 2023-07-11 17:55:18,634 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45839] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1689098116506.4e4357287b129f0600b33397cb2004ec. with WAL disabled. Data may be lost in the event of a crash. 2023-07-11 17:55:18,634 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45839] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1689098116506.32200e46ee32133355d305b07aa3b428. with WAL disabled. Data may be lost in the event of a crash. 2023-07-11 17:55:18,637 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 17:55:18,659 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-07-11 17:55:18,659 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-07-11 17:55:18,659 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:55:18,659 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-07-11 17:55:18,659 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-07-11 17:55:18,660 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-07-11 17:55:18,660 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-07-11 17:55:18,661 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:55:18,661 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:18,661 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:55:18,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:55:18,662 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:18,662 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 17:55:18,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-07-11 17:55:18,662 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-07-11 17:55:18,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 17:55:18,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-07-11 17:55:18,663 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-07-11 17:55:18,663 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-07-11 17:55:18,663 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-07-11 17:55:18,663 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:55:18,663 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-07-11 17:55:18,664 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1689098116506.4e4357287b129f0600b33397cb2004ec. 2023-07-11 17:55:18,664 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1689098116506.4e4357287b129f0600b33397cb2004ec. started... 2023-07-11 17:55:18,666 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 4e4357287b129f0600b33397cb2004ec 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-07-11 17:55:18,666 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1689098116506.03ba78e07b3026a36a7cde3865422d82. 2023-07-11 17:55:18,666 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1689098116506.32200e46ee32133355d305b07aa3b428. 2023-07-11 17:55:18,666 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-07-11 17:55:18,666 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 17:55:18,666 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1689098116506.32200e46ee32133355d305b07aa3b428. started... 2023-07-11 17:55:18,666 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1689098116506.03ba78e07b3026a36a7cde3865422d82. started... 2023-07-11 17:55:18,666 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 32200e46ee32133355d305b07aa3b428 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-07-11 17:55:18,666 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 03ba78e07b3026a36a7cde3865422d82 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-07-11 17:55:19,092 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230711ecbe7db5de5f415b8e48ed76177de75e to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20230711ecbe7db5de5f415b8e48ed76177de75e 2023-07-11 17:55:19,093 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023071134f0a592ca1a4576abe13ad0225aea32 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b2023071134f0a592ca1a4576abe13ad0225aea32 2023-07-11 17:55:19,093 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023071116b4042f6d2046cdbb469dfb99dbe45d to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e2023071116b4042f6d2046cdbb469dfb99dbe45d 2023-07-11 17:55:19,546 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/32200e46ee32133355d305b07aa3b428/.tmp/family1/405bab82dfaa446aafc456e0b8ab6279 2023-07-11 17:55:19,549 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/03ba78e07b3026a36a7cde3865422d82/.tmp/family1/1390f2e0215b46e7a68e4dc062e659b8 2023-07-11 17:55:19,571 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/4e4357287b129f0600b33397cb2004ec/.tmp/family1/da7eb0ff1da24bb08a33e8e8e01cb387 2023-07-11 17:55:19,594 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023071187b0c94c1b584f7687c7b03cde8219fa to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e2023071187b0c94c1b584f7687c7b03cde8219fa 2023-07-11 17:55:19,630 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230711034a1ab49915464f9a5a5e41c319011d to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20230711034a1ab49915464f9a5a5e41c319011d 2023-07-11 17:55:19,993 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230711206cd05ccc074facb15e08130c123f40 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20230711206cd05ccc074facb15e08130c123f40 2023-07-11 17:55:20,026 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/03ba78e07b3026a36a7cde3865422d82/.tmp/family2/fba194464f3f4eb99ddfdf6adf2268a1 2023-07-11 17:55:20,031 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/03ba78e07b3026a36a7cde3865422d82/.tmp/family1/1390f2e0215b46e7a68e4dc062e659b8 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/03ba78e07b3026a36a7cde3865422d82/family1/1390f2e0215b46e7a68e4dc062e659b8 2023-07-11 17:55:20,037 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/03ba78e07b3026a36a7cde3865422d82/family1/1390f2e0215b46e7a68e4dc062e659b8, entries=4, sequenceid=5, filesize=5.4 K 2023-07-11 17:55:20,038 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/03ba78e07b3026a36a7cde3865422d82/.tmp/family2/fba194464f3f4eb99ddfdf6adf2268a1 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/03ba78e07b3026a36a7cde3865422d82/family2/fba194464f3f4eb99ddfdf6adf2268a1 2023-07-11 17:55:20,042 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/03ba78e07b3026a36a7cde3865422d82/family2/fba194464f3f4eb99ddfdf6adf2268a1, entries=2, sequenceid=5, filesize=5.1 K 2023-07-11 17:55:20,043 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 03ba78e07b3026a36a7cde3865422d82 in 1377ms, sequenceid=5, compaction requested=false 2023-07-11 17:55:20,043 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'ns:testMinorCompaction' 2023-07-11 17:55:20,044 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 03ba78e07b3026a36a7cde3865422d82: 2023-07-11 17:55:20,044 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1689098116506.03ba78e07b3026a36a7cde3865422d82. 2023-07-11 17:55:20,044 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-07-11 17:55:20,048 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/4e4357287b129f0600b33397cb2004ec/.tmp/family2/a01375ac3ddf4dc3aa1d32048125139d 2023-07-11 17:55:20,054 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/4e4357287b129f0600b33397cb2004ec/.tmp/family1/da7eb0ff1da24bb08a33e8e8e01cb387 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/4e4357287b129f0600b33397cb2004ec/family1/da7eb0ff1da24bb08a33e8e8e01cb387 2023-07-11 17:55:20,059 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/4e4357287b129f0600b33397cb2004ec/family1/da7eb0ff1da24bb08a33e8e8e01cb387, entries=4, sequenceid=5, filesize=5.4 K 2023-07-11 17:55:20,060 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/4e4357287b129f0600b33397cb2004ec/.tmp/family2/a01375ac3ddf4dc3aa1d32048125139d as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/4e4357287b129f0600b33397cb2004ec/family2/a01375ac3ddf4dc3aa1d32048125139d 2023-07-11 17:55:20,065 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/4e4357287b129f0600b33397cb2004ec/family2/a01375ac3ddf4dc3aa1d32048125139d, entries=2, sequenceid=5, filesize=5.1 K 2023-07-11 17:55:20,066 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 4e4357287b129f0600b33397cb2004ec in 1400ms, sequenceid=5, compaction requested=false 2023-07-11 17:55:20,067 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 4e4357287b129f0600b33397cb2004ec: 2023-07-11 17:55:20,067 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1689098116506.4e4357287b129f0600b33397cb2004ec. 2023-07-11 17:55:20,067 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-07-11 17:55:20,405 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/32200e46ee32133355d305b07aa3b428/.tmp/family2/3629ded94de0471998b360504cdcbcdb 2023-07-11 17:55:20,409 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/32200e46ee32133355d305b07aa3b428/.tmp/family1/405bab82dfaa446aafc456e0b8ab6279 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/32200e46ee32133355d305b07aa3b428/family1/405bab82dfaa446aafc456e0b8ab6279 2023-07-11 17:55:20,412 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/32200e46ee32133355d305b07aa3b428/family1/405bab82dfaa446aafc456e0b8ab6279, entries=4, sequenceid=5, filesize=5.4 K 2023-07-11 17:55:20,413 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/32200e46ee32133355d305b07aa3b428/.tmp/family2/3629ded94de0471998b360504cdcbcdb as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/32200e46ee32133355d305b07aa3b428/family2/3629ded94de0471998b360504cdcbcdb 2023-07-11 17:55:20,416 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/32200e46ee32133355d305b07aa3b428/family2/3629ded94de0471998b360504cdcbcdb, entries=2, sequenceid=5, filesize=5.1 K 2023-07-11 17:55:20,417 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 32200e46ee32133355d305b07aa3b428 in 1751ms, sequenceid=5, compaction requested=false 2023-07-11 17:55:20,417 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 32200e46ee32133355d305b07aa3b428: 2023-07-11 17:55:20,417 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1689098116506.32200e46ee32133355d305b07aa3b428. 2023-07-11 17:55:20,417 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-07-11 17:55:20,417 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-07-11 17:55:20,417 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:20,417 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-07-11 17:55:20,417 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-07-11 17:55:20,419 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:20,419 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-07-11 17:55:20,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:20,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:55:20,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:55:20,419 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-07-11 17:55:20,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:55:20,419 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 17:55:20,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:55:20,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-07-11 17:55:20,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:20,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:55:20,420 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-07-11 17:55:20,420 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1139bbb8[Count = 0] remaining members to acquire global barrier 2023-07-11 17:55:20,420 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-07-11 17:55:20,420 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-07-11 17:55:20,421 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-07-11 17:55:20,421 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-07-11 17:55:20,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-07-11 17:55:20,421 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-07-11 17:55:20,421 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-07-11 17:55:20,421 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase9.apache.org,45839,1689097999112' in zk 2023-07-11 17:55:20,421 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:20,422 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 17:55:20,423 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:20,423 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-07-11 17:55:20,423 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:55:20,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:20,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:55:20,423 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-07-11 17:55:20,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:55:20,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:55:20,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:55:20,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-07-11 17:55:20,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:20,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:55:20,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-07-11 17:55:20,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:20,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase9.apache.org,45839,1689097999112': 2023-07-11 17:55:20,425 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-07-11 17:55:20,425 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-07-11 17:55:20,425 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 17:55:20,425 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 17:55:20,425 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-07-11 17:55:20,425 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 17:55:20,427 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-07-11 17:55:20,427 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-07-11 17:55:20,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-07-11 17:55:20,427 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-07-11 17:55:20,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:55:20,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:55:20,427 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:55:20,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-07-11 17:55:20,427 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:20,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:55:20,427 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:55:20,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:55:20,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-07-11 17:55:20,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-07-11 17:55:20,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:55:20,428 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:20,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-07-11 17:55:20,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:20,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:55:20,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-07-11 17:55:20,430 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:20,430 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-07-11 17:55:20,430 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:55:20,430 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-07-11 17:55:20,430 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:55:20,430 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:20,431 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-07-11 17:55:20,431 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-07-11 17:55:20,431 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-07-11 17:55:20,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:55:20,430 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-07-11 17:55:20,431 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 17:55:20,430 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:55:20,430 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:55:20,431 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-07-11 17:55:20,431 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:55:20,431 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-07-11 17:55:20,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:55:20,431 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 17:55:20,531 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 17:55:20,532 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 17:55:20,533 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45839] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1689098116506.03ba78e07b3026a36a7cde3865422d82. with WAL disabled. Data may be lost in the event of a crash. 2023-07-11 17:55:20,533 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45839] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1689098116506.4e4357287b129f0600b33397cb2004ec. with WAL disabled. Data may be lost in the event of a crash. 2023-07-11 17:55:20,534 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45839] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1689098116506.32200e46ee32133355d305b07aa3b428. with WAL disabled. Data may be lost in the event of a crash. 2023-07-11 17:55:20,536 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 17:55:20,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-07-11 17:55:20,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-07-11 17:55:20,538 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-07-11 17:55:20,538 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:55:20,538 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-07-11 17:55:20,538 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-07-11 17:55:20,538 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-07-11 17:55:20,538 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-07-11 17:55:20,539 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:20,539 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:55:20,539 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:55:20,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:55:20,539 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:20,539 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 17:55:20,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-07-11 17:55:20,540 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-07-11 17:55:20,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 17:55:20,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-07-11 17:55:20,540 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-07-11 17:55:20,540 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-07-11 17:55:20,540 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-07-11 17:55:20,540 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-07-11 17:55:20,540 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:55:20,540 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-07-11 17:55:20,541 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1689098116506.4e4357287b129f0600b33397cb2004ec. 2023-07-11 17:55:20,541 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1689098116506.4e4357287b129f0600b33397cb2004ec. started... 2023-07-11 17:55:20,541 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-07-11 17:55:20,541 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 17:55:20,541 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1689098116506.32200e46ee32133355d305b07aa3b428. 2023-07-11 17:55:20,541 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1689098116506.03ba78e07b3026a36a7cde3865422d82. 2023-07-11 17:55:20,541 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1689098116506.32200e46ee32133355d305b07aa3b428. started... 2023-07-11 17:55:20,541 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 4e4357287b129f0600b33397cb2004ec 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-07-11 17:55:20,541 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1689098116506.03ba78e07b3026a36a7cde3865422d82. started... 2023-07-11 17:55:20,541 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 32200e46ee32133355d305b07aa3b428 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-07-11 17:55:20,541 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 03ba78e07b3026a36a7cde3865422d82 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-07-11 17:55:20,552 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307116af6014a015a424f8825e5926aaf42bc to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202307116af6014a015a424f8825e5926aaf42bc 2023-07-11 17:55:20,556 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/03ba78e07b3026a36a7cde3865422d82/.tmp/family1/b2b73bd5c52247e595d119beceaaa7da 2023-07-11 17:55:20,954 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230711965bab2d4ee74e3aafde2f7635ba04d1 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230711965bab2d4ee74e3aafde2f7635ba04d1 2023-07-11 17:55:20,954 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230711288d6f45b30b4642b7890928700dce54 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20230711288d6f45b30b4642b7890928700dce54 2023-07-11 17:55:20,979 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230711b8419f93135b4306b45647fd41e44296 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20230711b8419f93135b4306b45647fd41e44296 2023-07-11 17:55:21,396 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/32200e46ee32133355d305b07aa3b428/.tmp/family1/3f0789dba10b407fa8dea4d972b2be00 2023-07-11 17:55:21,397 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/4e4357287b129f0600b33397cb2004ec/.tmp/family1/08dab25fa5a64508b36d5fe0201af1f5 2023-07-11 17:55:21,410 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/03ba78e07b3026a36a7cde3865422d82/.tmp/family2/646e3275aff94060b1f3239386439c88 2023-07-11 17:55:21,414 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/03ba78e07b3026a36a7cde3865422d82/.tmp/family1/b2b73bd5c52247e595d119beceaaa7da as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/03ba78e07b3026a36a7cde3865422d82/family1/b2b73bd5c52247e595d119beceaaa7da 2023-07-11 17:55:21,417 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/03ba78e07b3026a36a7cde3865422d82/family1/b2b73bd5c52247e595d119beceaaa7da, entries=4, sequenceid=9, filesize=5.4 K 2023-07-11 17:55:21,418 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/03ba78e07b3026a36a7cde3865422d82/.tmp/family2/646e3275aff94060b1f3239386439c88 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/03ba78e07b3026a36a7cde3865422d82/family2/646e3275aff94060b1f3239386439c88 2023-07-11 17:55:21,421 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/03ba78e07b3026a36a7cde3865422d82/family2/646e3275aff94060b1f3239386439c88, entries=2, sequenceid=9, filesize=5.1 K 2023-07-11 17:55:21,422 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 03ba78e07b3026a36a7cde3865422d82 in 881ms, sequenceid=9, compaction requested=false 2023-07-11 17:55:21,422 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 03ba78e07b3026a36a7cde3865422d82: 2023-07-11 17:55:21,422 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1689098116506.03ba78e07b3026a36a7cde3865422d82. 2023-07-11 17:55:21,422 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-07-11 17:55:21,815 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202307117aa07994ef774a1797f55be002571edc to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c202307117aa07994ef774a1797f55be002571edc 2023-07-11 17:55:21,815 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230711961b45559df54f67bdd2c796153fc7f8 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20230711961b45559df54f67bdd2c796153fc7f8 2023-07-11 17:55:22,221 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/4e4357287b129f0600b33397cb2004ec/.tmp/family2/e0ef21c26c504235a1dd57bb8e8fc329 2023-07-11 17:55:22,221 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/32200e46ee32133355d305b07aa3b428/.tmp/family2/aa5de3bef0d8453db9f192998f7eb6c2 2023-07-11 17:55:22,225 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/32200e46ee32133355d305b07aa3b428/.tmp/family1/3f0789dba10b407fa8dea4d972b2be00 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/32200e46ee32133355d305b07aa3b428/family1/3f0789dba10b407fa8dea4d972b2be00 2023-07-11 17:55:22,225 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/4e4357287b129f0600b33397cb2004ec/.tmp/family1/08dab25fa5a64508b36d5fe0201af1f5 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/4e4357287b129f0600b33397cb2004ec/family1/08dab25fa5a64508b36d5fe0201af1f5 2023-07-11 17:55:22,228 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/32200e46ee32133355d305b07aa3b428/family1/3f0789dba10b407fa8dea4d972b2be00, entries=4, sequenceid=9, filesize=5.4 K 2023-07-11 17:55:22,228 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/4e4357287b129f0600b33397cb2004ec/family1/08dab25fa5a64508b36d5fe0201af1f5, entries=4, sequenceid=9, filesize=5.4 K 2023-07-11 17:55:22,229 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/32200e46ee32133355d305b07aa3b428/.tmp/family2/aa5de3bef0d8453db9f192998f7eb6c2 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/32200e46ee32133355d305b07aa3b428/family2/aa5de3bef0d8453db9f192998f7eb6c2 2023-07-11 17:55:22,229 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/4e4357287b129f0600b33397cb2004ec/.tmp/family2/e0ef21c26c504235a1dd57bb8e8fc329 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/4e4357287b129f0600b33397cb2004ec/family2/e0ef21c26c504235a1dd57bb8e8fc329 2023-07-11 17:55:22,232 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/32200e46ee32133355d305b07aa3b428/family2/aa5de3bef0d8453db9f192998f7eb6c2, entries=2, sequenceid=9, filesize=5.1 K 2023-07-11 17:55:22,232 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/4e4357287b129f0600b33397cb2004ec/family2/e0ef21c26c504235a1dd57bb8e8fc329, entries=2, sequenceid=9, filesize=5.1 K 2023-07-11 17:55:22,233 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 4e4357287b129f0600b33397cb2004ec in 1692ms, sequenceid=9, compaction requested=false 2023-07-11 17:55:22,233 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 32200e46ee32133355d305b07aa3b428 in 1692ms, sequenceid=9, compaction requested=false 2023-07-11 17:55:22,233 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 4e4357287b129f0600b33397cb2004ec: 2023-07-11 17:55:22,233 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 32200e46ee32133355d305b07aa3b428: 2023-07-11 17:55:22,233 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1689098116506.4e4357287b129f0600b33397cb2004ec. 2023-07-11 17:55:22,233 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1689098116506.32200e46ee32133355d305b07aa3b428. 2023-07-11 17:55:22,233 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-07-11 17:55:22,233 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-07-11 17:55:22,233 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-07-11 17:55:22,233 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:22,234 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-07-11 17:55:22,234 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-07-11 17:55:22,235 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:22,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:22,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:55:22,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:55:22,235 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-07-11 17:55:22,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:55:22,235 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-07-11 17:55:22,236 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 17:55:22,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:55:22,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-07-11 17:55:22,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:22,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:55:22,237 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-07-11 17:55:22,237 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@34459b82[Count = 0] remaining members to acquire global barrier 2023-07-11 17:55:22,237 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-07-11 17:55:22,237 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-07-11 17:55:22,239 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-07-11 17:55:22,239 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-07-11 17:55:22,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-07-11 17:55:22,239 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-07-11 17:55:22,239 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-07-11 17:55:22,239 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:22,239 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 17:55:22,239 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase9.apache.org,45839,1689097999112' in zk 2023-07-11 17:55:22,244 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:22,244 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-07-11 17:55:22,244 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:55:22,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:22,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:55:22,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:55:22,244 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-07-11 17:55:22,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:55:22,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:55:22,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-07-11 17:55:22,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:22,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:55:22,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-07-11 17:55:22,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:22,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase9.apache.org,45839,1689097999112': 2023-07-11 17:55:22,246 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-07-11 17:55:22,246 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-07-11 17:55:22,246 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 17:55:22,246 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 17:55:22,246 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-07-11 17:55:22,246 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 17:55:22,247 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-07-11 17:55:22,247 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-07-11 17:55:22,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-07-11 17:55:22,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:55:22,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:55:22,247 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-07-11 17:55:22,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-07-11 17:55:22,247 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:55:22,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:55:22,248 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:55:22,248 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:22,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:55:22,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-07-11 17:55:22,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-07-11 17:55:22,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:55:22,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-07-11 17:55:22,249 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:22,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:22,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:55:22,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-07-11 17:55:22,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:22,251 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:22,251 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-07-11 17:55:22,251 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-07-11 17:55:22,251 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:55:22,251 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:22,251 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-07-11 17:55:22,251 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 17:55:22,251 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-07-11 17:55:22,251 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-07-11 17:55:22,251 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-07-11 17:55:22,251 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:55:22,251 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:55:22,251 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-07-11 17:55:22,251 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:55:22,251 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-07-11 17:55:22,251 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 17:55:22,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:55:22,252 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:55:22,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:55:22,351 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 17:55:22,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 17:55:22,353 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45839] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1689098116506.03ba78e07b3026a36a7cde3865422d82. with WAL disabled. Data may be lost in the event of a crash. 2023-07-11 17:55:22,354 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45839] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1689098116506.4e4357287b129f0600b33397cb2004ec. with WAL disabled. Data may be lost in the event of a crash. 2023-07-11 17:55:22,354 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45839] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1689098116506.32200e46ee32133355d305b07aa3b428. with WAL disabled. Data may be lost in the event of a crash. 2023-07-11 17:55:22,356 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 17:55:22,357 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-07-11 17:55:22,357 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-07-11 17:55:22,357 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-07-11 17:55:22,357 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:55:22,357 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-07-11 17:55:22,358 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-07-11 17:55:22,358 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-07-11 17:55:22,358 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-07-11 17:55:22,359 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:22,360 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:55:22,360 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:55:22,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:55:22,360 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:22,360 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 17:55:22,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-07-11 17:55:22,360 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-07-11 17:55:22,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 17:55:22,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-07-11 17:55:22,361 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-07-11 17:55:22,361 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-07-11 17:55:22,361 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-07-11 17:55:22,361 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-07-11 17:55:22,361 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:55:22,361 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-07-11 17:55:22,361 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1689098116506.4e4357287b129f0600b33397cb2004ec. 2023-07-11 17:55:22,361 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1689098116506.03ba78e07b3026a36a7cde3865422d82. 2023-07-11 17:55:22,361 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1689098116506.32200e46ee32133355d305b07aa3b428. 2023-07-11 17:55:22,361 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1689098116506.03ba78e07b3026a36a7cde3865422d82. started... 2023-07-11 17:55:22,361 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1689098116506.4e4357287b129f0600b33397cb2004ec. started... 2023-07-11 17:55:22,361 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-07-11 17:55:22,362 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 03ba78e07b3026a36a7cde3865422d82 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-07-11 17:55:22,362 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 4e4357287b129f0600b33397cb2004ec 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-07-11 17:55:22,361 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1689098116506.32200e46ee32133355d305b07aa3b428. started... 2023-07-11 17:55:22,362 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 17:55:22,362 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 32200e46ee32133355d305b07aa3b428 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-07-11 17:55:22,377 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230711fbeb20c271414e61aa133a8bc58ff984 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230711fbeb20c271414e61aa133a8bc58ff984 2023-07-11 17:55:22,774 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230711e286b029893745f7956609eabf46b118 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20230711e286b029893745f7956609eabf46b118 2023-07-11 17:55:22,777 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023071129deaf9dc4504890a16d278dce6be18a to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c2023071129deaf9dc4504890a16d278dce6be18a 2023-07-11 17:55:22,787 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/4e4357287b129f0600b33397cb2004ec/.tmp/family1/f3d2d7da605a4a469eb56102347d9fbc 2023-07-11 17:55:22,799 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230711475b03feb0ac4aed8873a42c546ab73e to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20230711475b03feb0ac4aed8873a42c546ab73e 2023-07-11 17:55:22,803 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/4e4357287b129f0600b33397cb2004ec/.tmp/family2/9c317965b41b434592b4a629540e63fd 2023-07-11 17:55:22,806 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/4e4357287b129f0600b33397cb2004ec/.tmp/family1/f3d2d7da605a4a469eb56102347d9fbc as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/4e4357287b129f0600b33397cb2004ec/family1/f3d2d7da605a4a469eb56102347d9fbc 2023-07-11 17:55:22,811 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/4e4357287b129f0600b33397cb2004ec/family1/f3d2d7da605a4a469eb56102347d9fbc, entries=4, sequenceid=13, filesize=5.4 K 2023-07-11 17:55:22,811 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/4e4357287b129f0600b33397cb2004ec/.tmp/family2/9c317965b41b434592b4a629540e63fd as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/4e4357287b129f0600b33397cb2004ec/family2/9c317965b41b434592b4a629540e63fd 2023-07-11 17:55:22,821 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/4e4357287b129f0600b33397cb2004ec/family2/9c317965b41b434592b4a629540e63fd, entries=2, sequenceid=13, filesize=5.1 K 2023-07-11 17:55:22,821 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 4e4357287b129f0600b33397cb2004ec in 459ms, sequenceid=13, compaction requested=true 2023-07-11 17:55:22,822 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 4e4357287b129f0600b33397cb2004ec: 2023-07-11 17:55:22,822 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1689098116506.4e4357287b129f0600b33397cb2004ec. 2023-07-11 17:55:22,822 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-07-11 17:55:23,168 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-07-11 17:55:23,180 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/03ba78e07b3026a36a7cde3865422d82/.tmp/family1/1fd8fbb361b54a4094d71bf39dc06a1f 2023-07-11 17:55:23,181 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/32200e46ee32133355d305b07aa3b428/.tmp/family1/858e8606487c4a07931a6e9465d6ec7d 2023-07-11 17:55:23,204 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023071124f7ea8ac3be4f87a662f5b380056d40 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c2023071124f7ea8ac3be4f87a662f5b380056d40 2023-07-11 17:55:23,605 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230711e0eed141c1af49dca1a37b7351066aea to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20230711e0eed141c1af49dca1a37b7351066aea 2023-07-11 17:55:23,608 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/32200e46ee32133355d305b07aa3b428/.tmp/family2/80ab816412f74471a0e48e682cbf8a6d 2023-07-11 17:55:23,612 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/32200e46ee32133355d305b07aa3b428/.tmp/family1/858e8606487c4a07931a6e9465d6ec7d as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/32200e46ee32133355d305b07aa3b428/family1/858e8606487c4a07931a6e9465d6ec7d 2023-07-11 17:55:23,616 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/32200e46ee32133355d305b07aa3b428/family1/858e8606487c4a07931a6e9465d6ec7d, entries=4, sequenceid=13, filesize=5.4 K 2023-07-11 17:55:23,616 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/32200e46ee32133355d305b07aa3b428/.tmp/family2/80ab816412f74471a0e48e682cbf8a6d as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/32200e46ee32133355d305b07aa3b428/family2/80ab816412f74471a0e48e682cbf8a6d 2023-07-11 17:55:23,619 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/32200e46ee32133355d305b07aa3b428/family2/80ab816412f74471a0e48e682cbf8a6d, entries=2, sequenceid=13, filesize=5.1 K 2023-07-11 17:55:23,620 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 32200e46ee32133355d305b07aa3b428 in 1258ms, sequenceid=13, compaction requested=true 2023-07-11 17:55:23,620 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 32200e46ee32133355d305b07aa3b428: 2023-07-11 17:55:23,620 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1689098116506.32200e46ee32133355d305b07aa3b428. 2023-07-11 17:55:23,620 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-07-11 17:55:24,010 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/03ba78e07b3026a36a7cde3865422d82/.tmp/family2/94e14858f91843e58f652bc083a2975c 2023-07-11 17:55:24,015 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/03ba78e07b3026a36a7cde3865422d82/.tmp/family1/1fd8fbb361b54a4094d71bf39dc06a1f as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/03ba78e07b3026a36a7cde3865422d82/family1/1fd8fbb361b54a4094d71bf39dc06a1f 2023-07-11 17:55:24,018 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/03ba78e07b3026a36a7cde3865422d82/family1/1fd8fbb361b54a4094d71bf39dc06a1f, entries=4, sequenceid=13, filesize=5.4 K 2023-07-11 17:55:24,019 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/03ba78e07b3026a36a7cde3865422d82/.tmp/family2/94e14858f91843e58f652bc083a2975c as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/03ba78e07b3026a36a7cde3865422d82/family2/94e14858f91843e58f652bc083a2975c 2023-07-11 17:55:24,022 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/03ba78e07b3026a36a7cde3865422d82/family2/94e14858f91843e58f652bc083a2975c, entries=2, sequenceid=13, filesize=5.1 K 2023-07-11 17:55:24,023 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 03ba78e07b3026a36a7cde3865422d82 in 1661ms, sequenceid=13, compaction requested=true 2023-07-11 17:55:24,023 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 03ba78e07b3026a36a7cde3865422d82: 2023-07-11 17:55:24,023 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1689098116506.03ba78e07b3026a36a7cde3865422d82. 2023-07-11 17:55:24,023 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-07-11 17:55:24,023 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-07-11 17:55:24,023 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:24,023 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-07-11 17:55:24,023 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-07-11 17:55:24,025 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:24,025 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-07-11 17:55:24,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:24,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:55:24,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:55:24,025 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-07-11 17:55:24,025 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 17:55:24,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:55:24,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:55:24,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-07-11 17:55:24,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:24,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:55:24,026 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-07-11 17:55:24,026 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@687d02c9[Count = 0] remaining members to acquire global barrier 2023-07-11 17:55:24,026 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-07-11 17:55:24,026 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-07-11 17:55:24,027 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-07-11 17:55:24,027 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-07-11 17:55:24,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-07-11 17:55:24,028 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-07-11 17:55:24,028 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-07-11 17:55:24,028 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase9.apache.org,45839,1689097999112' in zk 2023-07-11 17:55:24,028 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:24,028 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 17:55:24,029 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:24,029 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-07-11 17:55:24,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:24,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:55:24,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:55:24,029 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:55:24,029 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-07-11 17:55:24,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:55:24,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:55:24,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-07-11 17:55:24,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:24,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:55:24,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-07-11 17:55:24,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:24,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase9.apache.org,45839,1689097999112': 2023-07-11 17:55:24,031 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-07-11 17:55:24,031 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-07-11 17:55:24,031 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 17:55:24,031 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 17:55:24,031 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-07-11 17:55:24,031 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 17:55:24,033 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-07-11 17:55:24,033 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-07-11 17:55:24,033 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-07-11 17:55:24,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-07-11 17:55:24,033 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:55:24,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-07-11 17:55:24,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:55:24,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:55:24,034 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:55:24,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:55:24,034 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:24,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:55:24,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-07-11 17:55:24,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-07-11 17:55:24,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:55:24,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-07-11 17:55:24,035 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:24,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:24,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:55:24,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-07-11 17:55:24,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:24,037 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:24,037 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-07-11 17:55:24,037 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-07-11 17:55:24,037 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:55:24,037 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:55:24,037 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:24,037 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:55:24,037 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-07-11 17:55:24,037 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:55:24,037 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-07-11 17:55:24,038 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 17:55:24,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:55:24,037 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-07-11 17:55:24,038 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-07-11 17:55:24,038 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-07-11 17:55:24,038 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-07-11 17:55:24,038 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:55:24,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:55:24,038 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 17:55:24,138 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 17:55:24,139 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 17:55:24,140 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45839] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1689098116506.03ba78e07b3026a36a7cde3865422d82. with WAL disabled. Data may be lost in the event of a crash. 2023-07-11 17:55:24,140 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45839] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1689098116506.4e4357287b129f0600b33397cb2004ec. with WAL disabled. Data may be lost in the event of a crash. 2023-07-11 17:55:24,140 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45839] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1689098116506.32200e46ee32133355d305b07aa3b428. with WAL disabled. Data may be lost in the event of a crash. 2023-07-11 17:55:24,142 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 17:55:24,145 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-07-11 17:55:24,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-07-11 17:55:24,146 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-07-11 17:55:24,146 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:55:24,146 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-07-11 17:55:24,146 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-07-11 17:55:24,146 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-07-11 17:55:24,146 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-07-11 17:55:24,148 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:24,148 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:55:24,148 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:55:24,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:55:24,148 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:24,148 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 17:55:24,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-07-11 17:55:24,149 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-07-11 17:55:24,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 17:55:24,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-07-11 17:55:24,149 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-07-11 17:55:24,149 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-07-11 17:55:24,149 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-07-11 17:55:24,149 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-07-11 17:55:24,149 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:55:24,149 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-07-11 17:55:24,150 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1689098116506.4e4357287b129f0600b33397cb2004ec. 2023-07-11 17:55:24,150 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1689098116506.4e4357287b129f0600b33397cb2004ec. started... 2023-07-11 17:55:24,150 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1689098116506.03ba78e07b3026a36a7cde3865422d82. 2023-07-11 17:55:24,150 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1689098116506.32200e46ee32133355d305b07aa3b428. 2023-07-11 17:55:24,150 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-07-11 17:55:24,150 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 17:55:24,150 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 4e4357287b129f0600b33397cb2004ec 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-07-11 17:55:24,150 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1689098116506.32200e46ee32133355d305b07aa3b428. started... 2023-07-11 17:55:24,150 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1689098116506.03ba78e07b3026a36a7cde3865422d82. started... 2023-07-11 17:55:24,150 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 32200e46ee32133355d305b07aa3b428 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-07-11 17:55:24,150 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 03ba78e07b3026a36a7cde3865422d82 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-07-11 17:55:24,164 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230711d1829fa0ce2c41d8a0be554b52cd1ecf to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20230711d1829fa0ce2c41d8a0be554b52cd1ecf 2023-07-11 17:55:24,165 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230711f15a3e72f1854a1fbddb6fc9cf8b5666 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230711f15a3e72f1854a1fbddb6fc9cf8b5666 2023-07-11 17:55:24,171 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/4e4357287b129f0600b33397cb2004ec/.tmp/family1/9beab2605de343619b79cc0934e878e3 2023-07-11 17:55:24,184 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230711bb1c0510521f43b68edd845242b50b3c to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20230711bb1c0510521f43b68edd845242b50b3c 2023-07-11 17:55:24,188 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/4e4357287b129f0600b33397cb2004ec/.tmp/family2/b677676982ed4d659bb69aa975fe87c4 2023-07-11 17:55:24,191 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/4e4357287b129f0600b33397cb2004ec/.tmp/family1/9beab2605de343619b79cc0934e878e3 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/4e4357287b129f0600b33397cb2004ec/family1/9beab2605de343619b79cc0934e878e3 2023-07-11 17:55:24,195 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/4e4357287b129f0600b33397cb2004ec/family1/9beab2605de343619b79cc0934e878e3, entries=4, sequenceid=17, filesize=5.4 K 2023-07-11 17:55:24,195 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/4e4357287b129f0600b33397cb2004ec/.tmp/family2/b677676982ed4d659bb69aa975fe87c4 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/4e4357287b129f0600b33397cb2004ec/family2/b677676982ed4d659bb69aa975fe87c4 2023-07-11 17:55:24,198 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/4e4357287b129f0600b33397cb2004ec/family2/b677676982ed4d659bb69aa975fe87c4, entries=2, sequenceid=17, filesize=5.1 K 2023-07-11 17:55:24,199 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 4e4357287b129f0600b33397cb2004ec in 49ms, sequenceid=17, compaction requested=true 2023-07-11 17:55:24,199 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 4e4357287b129f0600b33397cb2004ec: 2023-07-11 17:55:24,199 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1689098116506.4e4357287b129f0600b33397cb2004ec. 2023-07-11 17:55:24,199 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-07-11 17:55:24,564 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023071127a4c00ac03842ad9544a32497223f00 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c2023071127a4c00ac03842ad9544a32497223f00 2023-07-11 17:55:24,569 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/03ba78e07b3026a36a7cde3865422d82/.tmp/family1/064565ef2fce48c186b3534d3abed61f 2023-07-11 17:55:24,968 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/32200e46ee32133355d305b07aa3b428/.tmp/family1/6bcbb1c91c4342cd90d7ceba1fea7a65 2023-07-11 17:55:24,980 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230711898a810e534b4f79a0f79a0d0fc658b7 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20230711898a810e534b4f79a0f79a0d0fc658b7 2023-07-11 17:55:24,981 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307110c18f25fc92f4fdcaaeb34281f35acd9 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e202307110c18f25fc92f4fdcaaeb34281f35acd9 2023-07-11 17:55:25,385 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/32200e46ee32133355d305b07aa3b428/.tmp/family2/c205746f7134407583e99c2c2f354c94 2023-07-11 17:55:25,386 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/03ba78e07b3026a36a7cde3865422d82/.tmp/family2/6c43fe515e674717b27622d629dd2459 2023-07-11 17:55:25,389 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/32200e46ee32133355d305b07aa3b428/.tmp/family1/6bcbb1c91c4342cd90d7ceba1fea7a65 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/32200e46ee32133355d305b07aa3b428/family1/6bcbb1c91c4342cd90d7ceba1fea7a65 2023-07-11 17:55:25,389 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/03ba78e07b3026a36a7cde3865422d82/.tmp/family1/064565ef2fce48c186b3534d3abed61f as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/03ba78e07b3026a36a7cde3865422d82/family1/064565ef2fce48c186b3534d3abed61f 2023-07-11 17:55:25,392 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/32200e46ee32133355d305b07aa3b428/family1/6bcbb1c91c4342cd90d7ceba1fea7a65, entries=4, sequenceid=17, filesize=5.4 K 2023-07-11 17:55:25,392 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/03ba78e07b3026a36a7cde3865422d82/family1/064565ef2fce48c186b3534d3abed61f, entries=4, sequenceid=17, filesize=5.4 K 2023-07-11 17:55:25,393 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/32200e46ee32133355d305b07aa3b428/.tmp/family2/c205746f7134407583e99c2c2f354c94 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/32200e46ee32133355d305b07aa3b428/family2/c205746f7134407583e99c2c2f354c94 2023-07-11 17:55:25,393 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/03ba78e07b3026a36a7cde3865422d82/.tmp/family2/6c43fe515e674717b27622d629dd2459 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/03ba78e07b3026a36a7cde3865422d82/family2/6c43fe515e674717b27622d629dd2459 2023-07-11 17:55:25,396 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/32200e46ee32133355d305b07aa3b428/family2/c205746f7134407583e99c2c2f354c94, entries=2, sequenceid=17, filesize=5.1 K 2023-07-11 17:55:25,396 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/03ba78e07b3026a36a7cde3865422d82/family2/6c43fe515e674717b27622d629dd2459, entries=2, sequenceid=17, filesize=5.1 K 2023-07-11 17:55:25,397 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 32200e46ee32133355d305b07aa3b428 in 1247ms, sequenceid=17, compaction requested=true 2023-07-11 17:55:25,397 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 03ba78e07b3026a36a7cde3865422d82 in 1247ms, sequenceid=17, compaction requested=true 2023-07-11 17:55:25,397 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 32200e46ee32133355d305b07aa3b428: 2023-07-11 17:55:25,397 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 03ba78e07b3026a36a7cde3865422d82: 2023-07-11 17:55:25,397 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1689098116506.32200e46ee32133355d305b07aa3b428. 2023-07-11 17:55:25,397 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1689098116506.03ba78e07b3026a36a7cde3865422d82. 2023-07-11 17:55:25,397 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-07-11 17:55:25,397 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-07-11 17:55:25,397 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-07-11 17:55:25,397 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:25,397 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-07-11 17:55:25,397 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-07-11 17:55:25,399 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-07-11 17:55:25,399 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:25,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:25,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:55:25,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:55:25,399 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-07-11 17:55:25,399 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 17:55:25,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:55:25,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:55:25,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-07-11 17:55:25,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:25,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:55:25,400 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-07-11 17:55:25,400 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@21217c25[Count = 0] remaining members to acquire global barrier 2023-07-11 17:55:25,400 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-07-11 17:55:25,400 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-07-11 17:55:25,402 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-07-11 17:55:25,402 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-07-11 17:55:25,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-07-11 17:55:25,402 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-07-11 17:55:25,402 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-07-11 17:55:25,402 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase9.apache.org,45839,1689097999112' in zk 2023-07-11 17:55:25,402 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:25,403 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 17:55:25,404 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-07-11 17:55:25,404 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:55:25,404 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:25,404 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-07-11 17:55:25,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:25,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:55:25,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:55:25,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:55:25,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:55:25,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-07-11 17:55:25,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:25,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:55:25,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-07-11 17:55:25,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:25,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase9.apache.org,45839,1689097999112': 2023-07-11 17:55:25,406 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-07-11 17:55:25,406 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-07-11 17:55:25,406 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 17:55:25,406 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 17:55:25,406 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-07-11 17:55:25,406 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 17:55:25,407 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-07-11 17:55:25,407 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-07-11 17:55:25,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-07-11 17:55:25,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:55:25,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:55:25,408 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-07-11 17:55:25,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-07-11 17:55:25,408 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:55:25,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:55:25,408 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:55:25,408 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:25,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:55:25,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-07-11 17:55:25,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-07-11 17:55:25,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:55:25,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-07-11 17:55:25,409 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:25,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:25,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:55:25,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-07-11 17:55:25,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:25,411 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:25,411 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-07-11 17:55:25,411 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-07-11 17:55:25,411 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:25,411 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-07-11 17:55:25,411 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-07-11 17:55:25,411 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 17:55:25,411 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-07-11 17:55:25,411 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:55:25,411 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:55:25,411 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:55:25,411 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:55:25,411 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-07-11 17:55:25,411 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-07-11 17:55:25,411 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 17:55:25,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:55:25,412 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:55:25,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:55:25,511 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 17:55:25,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 17:55:25,523 DEBUG [Listener at localhost/43271] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-07-11 17:55:25,533 DEBUG [Listener at localhost/43271] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-07-11 17:55:25,540 DEBUG [Listener at localhost/43271] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-07-11 17:55:25,541 DEBUG [Listener at localhost/43271] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-07-11 17:55:25,565 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 17:55:25,567 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-07-11 17:55:25,567 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-07-11 17:55:25,567 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-07-11 17:55:25,567 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:55:25,567 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-07-11 17:55:25,567 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-07-11 17:55:25,567 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-07-11 17:55:25,567 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-07-11 17:55:25,569 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:25,569 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:55:25,569 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:55:25,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:55:25,569 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:25,569 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 17:55:25,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-07-11 17:55:25,570 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-07-11 17:55:25,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 17:55:25,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-07-11 17:55:25,570 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-07-11 17:55:25,570 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-07-11 17:55:25,570 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-07-11 17:55:25,570 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-07-11 17:55:25,570 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:55:25,570 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-07-11 17:55:25,571 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1689098116506.4e4357287b129f0600b33397cb2004ec. 2023-07-11 17:55:25,571 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1689098116506.03ba78e07b3026a36a7cde3865422d82. 2023-07-11 17:55:25,571 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1689098116506.4e4357287b129f0600b33397cb2004ec. started... 2023-07-11 17:55:25,571 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-07-11 17:55:25,571 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1689098116506.32200e46ee32133355d305b07aa3b428. 2023-07-11 17:55:25,571 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 17:55:25,571 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1689098116506.32200e46ee32133355d305b07aa3b428. started... 2023-07-11 17:55:25,571 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 4e4357287b129f0600b33397cb2004ec 2/2 column families, dataSize=138 B heapSize=944 B 2023-07-11 17:55:25,571 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 32200e46ee32133355d305b07aa3b428 2/2 column families, dataSize=138 B heapSize=944 B 2023-07-11 17:55:25,571 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1689098116506.03ba78e07b3026a36a7cde3865422d82. started... 2023-07-11 17:55:25,571 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 03ba78e07b3026a36a7cde3865422d82 2/2 column families, dataSize=138 B heapSize=944 B 2023-07-11 17:55:25,590 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/4e4357287b129f0600b33397cb2004ec/.tmp/family1/ffef037afcb043bda363e316582d5075 2023-07-11 17:55:25,593 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ffef037afcb043bda363e316582d5075 2023-07-11 17:55:26,000 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/03ba78e07b3026a36a7cde3865422d82/.tmp/family1/c45740a2459c4b98a37397be8fe54742 2023-07-11 17:55:26,005 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c45740a2459c4b98a37397be8fe54742 2023-07-11 17:55:26,032 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/4e4357287b129f0600b33397cb2004ec/.tmp/family2/921b70b7645c41b788ace170abc0db97 2023-07-11 17:55:26,036 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 921b70b7645c41b788ace170abc0db97 2023-07-11 17:55:26,037 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/4e4357287b129f0600b33397cb2004ec/.tmp/family1/ffef037afcb043bda363e316582d5075 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/4e4357287b129f0600b33397cb2004ec/family1/ffef037afcb043bda363e316582d5075 2023-07-11 17:55:26,042 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ffef037afcb043bda363e316582d5075 2023-07-11 17:55:26,042 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/4e4357287b129f0600b33397cb2004ec/family1/ffef037afcb043bda363e316582d5075, entries=3, sequenceid=23, filesize=5.0 K 2023-07-11 17:55:26,043 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/4e4357287b129f0600b33397cb2004ec/.tmp/family2/921b70b7645c41b788ace170abc0db97 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/4e4357287b129f0600b33397cb2004ec/family2/921b70b7645c41b788ace170abc0db97 2023-07-11 17:55:26,047 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 921b70b7645c41b788ace170abc0db97 2023-07-11 17:55:26,048 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/4e4357287b129f0600b33397cb2004ec/family2/921b70b7645c41b788ace170abc0db97, entries=1, sequenceid=23, filesize=5.0 K 2023-07-11 17:55:26,048 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 4e4357287b129f0600b33397cb2004ec in 477ms, sequenceid=23, compaction requested=true 2023-07-11 17:55:26,048 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 4e4357287b129f0600b33397cb2004ec: 2023-07-11 17:55:26,048 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1689098116506.4e4357287b129f0600b33397cb2004ec. 2023-07-11 17:55:26,049 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-07-11 17:55:26,435 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/32200e46ee32133355d305b07aa3b428/.tmp/family1/3e727df31c6e43a2840e9aa466b6dd8a 2023-07-11 17:55:26,438 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3e727df31c6e43a2840e9aa466b6dd8a 2023-07-11 17:55:26,852 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/03ba78e07b3026a36a7cde3865422d82/.tmp/family2/864f8336948a4be7bc4ea109d7a1fefb 2023-07-11 17:55:26,856 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 864f8336948a4be7bc4ea109d7a1fefb 2023-07-11 17:55:26,856 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/03ba78e07b3026a36a7cde3865422d82/.tmp/family1/c45740a2459c4b98a37397be8fe54742 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/03ba78e07b3026a36a7cde3865422d82/family1/c45740a2459c4b98a37397be8fe54742 2023-07-11 17:55:26,860 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c45740a2459c4b98a37397be8fe54742 2023-07-11 17:55:26,860 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/03ba78e07b3026a36a7cde3865422d82/family1/c45740a2459c4b98a37397be8fe54742, entries=3, sequenceid=23, filesize=5.0 K 2023-07-11 17:55:26,861 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/03ba78e07b3026a36a7cde3865422d82/.tmp/family2/864f8336948a4be7bc4ea109d7a1fefb as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/03ba78e07b3026a36a7cde3865422d82/family2/864f8336948a4be7bc4ea109d7a1fefb 2023-07-11 17:55:26,864 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 864f8336948a4be7bc4ea109d7a1fefb 2023-07-11 17:55:26,864 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/03ba78e07b3026a36a7cde3865422d82/family2/864f8336948a4be7bc4ea109d7a1fefb, entries=1, sequenceid=23, filesize=5.0 K 2023-07-11 17:55:26,865 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 03ba78e07b3026a36a7cde3865422d82 in 1294ms, sequenceid=23, compaction requested=true 2023-07-11 17:55:26,865 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 03ba78e07b3026a36a7cde3865422d82: 2023-07-11 17:55:26,865 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1689098116506.03ba78e07b3026a36a7cde3865422d82. 2023-07-11 17:55:26,866 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-07-11 17:55:27,250 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/32200e46ee32133355d305b07aa3b428/.tmp/family2/8d13d36d1b084f548627b0b6602508ae 2023-07-11 17:55:27,254 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8d13d36d1b084f548627b0b6602508ae 2023-07-11 17:55:27,255 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/32200e46ee32133355d305b07aa3b428/.tmp/family1/3e727df31c6e43a2840e9aa466b6dd8a as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/32200e46ee32133355d305b07aa3b428/family1/3e727df31c6e43a2840e9aa466b6dd8a 2023-07-11 17:55:27,258 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3e727df31c6e43a2840e9aa466b6dd8a 2023-07-11 17:55:27,259 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/32200e46ee32133355d305b07aa3b428/family1/3e727df31c6e43a2840e9aa466b6dd8a, entries=3, sequenceid=23, filesize=5.0 K 2023-07-11 17:55:27,259 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/32200e46ee32133355d305b07aa3b428/.tmp/family2/8d13d36d1b084f548627b0b6602508ae as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/32200e46ee32133355d305b07aa3b428/family2/8d13d36d1b084f548627b0b6602508ae 2023-07-11 17:55:27,263 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8d13d36d1b084f548627b0b6602508ae 2023-07-11 17:55:27,263 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/32200e46ee32133355d305b07aa3b428/family2/8d13d36d1b084f548627b0b6602508ae, entries=1, sequenceid=23, filesize=5.0 K 2023-07-11 17:55:27,264 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 32200e46ee32133355d305b07aa3b428 in 1693ms, sequenceid=23, compaction requested=true 2023-07-11 17:55:27,264 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 32200e46ee32133355d305b07aa3b428: 2023-07-11 17:55:27,264 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1689098116506.32200e46ee32133355d305b07aa3b428. 2023-07-11 17:55:27,264 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-07-11 17:55:27,264 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-07-11 17:55:27,264 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:27,264 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-07-11 17:55:27,264 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-07-11 17:55:27,266 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-07-11 17:55:27,266 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:27,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:27,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:55:27,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:55:27,266 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-07-11 17:55:27,266 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 17:55:27,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:55:27,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:55:27,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-07-11 17:55:27,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:27,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:55:27,268 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-07-11 17:55:27,268 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@44bb19a3[Count = 0] remaining members to acquire global barrier 2023-07-11 17:55:27,268 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-07-11 17:55:27,268 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-07-11 17:55:27,269 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-07-11 17:55:27,269 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-07-11 17:55:27,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-07-11 17:55:27,269 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-07-11 17:55:27,269 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-07-11 17:55:27,269 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:27,269 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 17:55:27,269 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase9.apache.org,45839,1689097999112' in zk 2023-07-11 17:55:27,270 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:27,270 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-07-11 17:55:27,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:27,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:55:27,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:55:27,271 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:55:27,271 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-07-11 17:55:27,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:55:27,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:55:27,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-07-11 17:55:27,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:27,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:55:27,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-07-11 17:55:27,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:27,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase9.apache.org,45839,1689097999112': 2023-07-11 17:55:27,273 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-07-11 17:55:27,273 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-07-11 17:55:27,273 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 17:55:27,273 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 17:55:27,273 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-07-11 17:55:27,273 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 17:55:27,281 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-07-11 17:55:27,281 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-07-11 17:55:27,281 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:55:27,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-07-11 17:55:27,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:55:27,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:55:27,281 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-07-11 17:55:27,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-07-11 17:55:27,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:55:27,282 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:27,282 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:55:27,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:55:27,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-07-11 17:55:27,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-07-11 17:55:27,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:55:27,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-07-11 17:55:27,283 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:27,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:27,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:55:27,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-07-11 17:55:27,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:27,289 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:27,289 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:55:27,289 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-07-11 17:55:27,289 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:55:27,289 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:55:27,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:55:27,289 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:55:27,289 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-07-11 17:55:27,289 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 17:55:27,289 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-07-11 17:55:27,290 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:27,290 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-07-11 17:55:27,290 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-07-11 17:55:27,290 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-07-11 17:55:27,290 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-07-11 17:55:27,290 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-07-11 17:55:27,290 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 17:55:27,290 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:55:27,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:55:27,390 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 17:55:27,391 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 17:55:27,392 DEBUG [Listener at localhost/43271] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-07-11 17:55:27,392 DEBUG [Listener at localhost/43271] regionserver.HStore(1912): 4e4357287b129f0600b33397cb2004ec/family1 is initiating major compaction (all files) 2023-07-11 17:55:27,392 INFO [Listener at localhost/43271] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-11 17:55:27,392 INFO [Listener at localhost/43271] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-11 17:55:27,392 INFO [Listener at localhost/43271] regionserver.HRegion(2259): Starting compaction of 4e4357287b129f0600b33397cb2004ec/family1 in ns:testMinorCompaction,1,1689098116506.4e4357287b129f0600b33397cb2004ec. 2023-07-11 17:55:27,392 INFO [Listener at localhost/43271] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/4e4357287b129f0600b33397cb2004ec/family1/da7eb0ff1da24bb08a33e8e8e01cb387, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/4e4357287b129f0600b33397cb2004ec/family1/08dab25fa5a64508b36d5fe0201af1f5, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/4e4357287b129f0600b33397cb2004ec/family1/f3d2d7da605a4a469eb56102347d9fbc, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/4e4357287b129f0600b33397cb2004ec/family1/9beab2605de343619b79cc0934e878e3, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/4e4357287b129f0600b33397cb2004ec/family1/ffef037afcb043bda363e316582d5075] into tmpdir=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/4e4357287b129f0600b33397cb2004ec/.tmp, totalSize=26.6 K 2023-07-11 17:55:27,393 DEBUG [Listener at localhost/43271] compactions.Compactor(207): Compacting da7eb0ff1da24bb08a33e8e8e01cb387, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1689098118634 2023-07-11 17:55:27,393 DEBUG [Listener at localhost/43271] compactions.Compactor(207): Compacting 08dab25fa5a64508b36d5fe0201af1f5, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1689098120533 2023-07-11 17:55:27,394 DEBUG [Listener at localhost/43271] compactions.Compactor(207): Compacting f3d2d7da605a4a469eb56102347d9fbc, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1689098122353 2023-07-11 17:55:27,394 DEBUG [Listener at localhost/43271] compactions.Compactor(207): Compacting 9beab2605de343619b79cc0934e878e3, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1689098124140 2023-07-11 17:55:27,395 DEBUG [Listener at localhost/43271] compactions.Compactor(207): Compacting ffef037afcb043bda363e316582d5075, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-07-11 17:55:27,404 INFO [Listener at localhost/43271] throttle.PressureAwareThroughputController(145): 4e4357287b129f0600b33397cb2004ec#family1#compaction#149 average throughput is 0.55 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-11 17:55:27,812 INFO [Listener at localhost/43271] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230711b3d24d7cc8424bf4b90a6c8413054394_del 2023-07-11 17:55:27,812 INFO [Listener at localhost/43271] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230711b3d24d7cc8424bf4b90a6c8413054394_del to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230711b3d24d7cc8424bf4b90a6c8413054394_del 2023-07-11 17:55:28,225 INFO [Listener at localhost/43271] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d1e8274a404747d480e1dfd7e9b23a9f 2023-07-11 17:55:28,226 DEBUG [Listener at localhost/43271] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/4e4357287b129f0600b33397cb2004ec/.tmp/family1/d1e8274a404747d480e1dfd7e9b23a9f as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/4e4357287b129f0600b33397cb2004ec/family1/d1e8274a404747d480e1dfd7e9b23a9f 2023-07-11 17:55:28,230 INFO [Listener at localhost/43271] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d1e8274a404747d480e1dfd7e9b23a9f 2023-07-11 17:55:28,231 INFO [Listener at localhost/43271] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 4e4357287b129f0600b33397cb2004ec/family1 of 4e4357287b129f0600b33397cb2004ec into d1e8274a404747d480e1dfd7e9b23a9f(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-11 17:55:28,231 DEBUG [Listener at localhost/43271] regionserver.HRegion(2289): Compaction status journal for 4e4357287b129f0600b33397cb2004ec: 2023-07-11 17:55:28,231 DEBUG [Listener at localhost/43271] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-07-11 17:55:28,231 DEBUG [Listener at localhost/43271] regionserver.HStore(1912): 4e4357287b129f0600b33397cb2004ec/family2 is initiating major compaction (all files) 2023-07-11 17:55:28,231 INFO [Listener at localhost/43271] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-11 17:55:28,231 INFO [Listener at localhost/43271] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-11 17:55:28,231 INFO [Listener at localhost/43271] regionserver.HRegion(2259): Starting compaction of 4e4357287b129f0600b33397cb2004ec/family2 in ns:testMinorCompaction,1,1689098116506.4e4357287b129f0600b33397cb2004ec. 2023-07-11 17:55:28,231 INFO [Listener at localhost/43271] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/4e4357287b129f0600b33397cb2004ec/family2/a01375ac3ddf4dc3aa1d32048125139d, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/4e4357287b129f0600b33397cb2004ec/family2/e0ef21c26c504235a1dd57bb8e8fc329, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/4e4357287b129f0600b33397cb2004ec/family2/9c317965b41b434592b4a629540e63fd, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/4e4357287b129f0600b33397cb2004ec/family2/b677676982ed4d659bb69aa975fe87c4, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/4e4357287b129f0600b33397cb2004ec/family2/921b70b7645c41b788ace170abc0db97] into tmpdir=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/4e4357287b129f0600b33397cb2004ec/.tmp, totalSize=25.3 K 2023-07-11 17:55:28,232 DEBUG [Listener at localhost/43271] compactions.Compactor(207): Compacting a01375ac3ddf4dc3aa1d32048125139d, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1689098118634 2023-07-11 17:55:28,232 DEBUG [Listener at localhost/43271] compactions.Compactor(207): Compacting e0ef21c26c504235a1dd57bb8e8fc329, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1689098120533 2023-07-11 17:55:28,233 DEBUG [Listener at localhost/43271] compactions.Compactor(207): Compacting 9c317965b41b434592b4a629540e63fd, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1689098122353 2023-07-11 17:55:28,233 DEBUG [Listener at localhost/43271] compactions.Compactor(207): Compacting b677676982ed4d659bb69aa975fe87c4, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1689098124140 2023-07-11 17:55:28,233 DEBUG [Listener at localhost/43271] compactions.Compactor(207): Compacting 921b70b7645c41b788ace170abc0db97, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-07-11 17:55:28,236 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/4e4357287b129f0600b33397cb2004ec/family1/da7eb0ff1da24bb08a33e8e8e01cb387, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/4e4357287b129f0600b33397cb2004ec/family1/08dab25fa5a64508b36d5fe0201af1f5, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/4e4357287b129f0600b33397cb2004ec/family1/f3d2d7da605a4a469eb56102347d9fbc, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/4e4357287b129f0600b33397cb2004ec/family1/9beab2605de343619b79cc0934e878e3, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/4e4357287b129f0600b33397cb2004ec/family1/ffef037afcb043bda363e316582d5075] to archive 2023-07-11 17:55:28,237 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 17:55:28,239 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/4e4357287b129f0600b33397cb2004ec/family1/da7eb0ff1da24bb08a33e8e8e01cb387 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/ns/testMinorCompaction/4e4357287b129f0600b33397cb2004ec/family1/da7eb0ff1da24bb08a33e8e8e01cb387 2023-07-11 17:55:28,240 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/4e4357287b129f0600b33397cb2004ec/family1/08dab25fa5a64508b36d5fe0201af1f5 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/ns/testMinorCompaction/4e4357287b129f0600b33397cb2004ec/family1/08dab25fa5a64508b36d5fe0201af1f5 2023-07-11 17:55:28,241 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/4e4357287b129f0600b33397cb2004ec/family1/f3d2d7da605a4a469eb56102347d9fbc to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/ns/testMinorCompaction/4e4357287b129f0600b33397cb2004ec/family1/f3d2d7da605a4a469eb56102347d9fbc 2023-07-11 17:55:28,242 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/4e4357287b129f0600b33397cb2004ec/family1/9beab2605de343619b79cc0934e878e3 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/ns/testMinorCompaction/4e4357287b129f0600b33397cb2004ec/family1/9beab2605de343619b79cc0934e878e3 2023-07-11 17:55:28,244 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/4e4357287b129f0600b33397cb2004ec/family1/ffef037afcb043bda363e316582d5075 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/ns/testMinorCompaction/4e4357287b129f0600b33397cb2004ec/family1/ffef037afcb043bda363e316582d5075 2023-07-11 17:55:28,244 INFO [Listener at localhost/43271] throttle.PressureAwareThroughputController(145): 4e4357287b129f0600b33397cb2004ec#family2#compaction#150 average throughput is 0.51 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-11 17:55:28,654 INFO [Listener at localhost/43271] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230711ed50987963e54dfcac652c4edc4b01ce_del 2023-07-11 17:55:28,654 INFO [Listener at localhost/43271] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230711ed50987963e54dfcac652c4edc4b01ce_del to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20230711ed50987963e54dfcac652c4edc4b01ce_del 2023-07-11 17:55:29,467 INFO [Listener at localhost/43271] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 80062546649d46d49cedb4b8ec799e18 2023-07-11 17:55:29,468 DEBUG [Listener at localhost/43271] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/4e4357287b129f0600b33397cb2004ec/.tmp/family2/80062546649d46d49cedb4b8ec799e18 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/4e4357287b129f0600b33397cb2004ec/family2/80062546649d46d49cedb4b8ec799e18 2023-07-11 17:55:29,471 INFO [Listener at localhost/43271] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 80062546649d46d49cedb4b8ec799e18 2023-07-11 17:55:29,472 INFO [Listener at localhost/43271] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 4e4357287b129f0600b33397cb2004ec/family2 of 4e4357287b129f0600b33397cb2004ec into 80062546649d46d49cedb4b8ec799e18(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-07-11 17:55:29,472 DEBUG [Listener at localhost/43271] regionserver.HRegion(2289): Compaction status journal for 4e4357287b129f0600b33397cb2004ec: 2023-07-11 17:55:29,472 DEBUG [Listener at localhost/43271] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-07-11 17:55:29,472 DEBUG [Listener at localhost/43271] regionserver.HStore(1912): 03ba78e07b3026a36a7cde3865422d82/family1 is initiating major compaction (all files) 2023-07-11 17:55:29,472 INFO [Listener at localhost/43271] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-11 17:55:29,472 INFO [Listener at localhost/43271] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-11 17:55:29,473 INFO [Listener at localhost/43271] regionserver.HRegion(2259): Starting compaction of 03ba78e07b3026a36a7cde3865422d82/family1 in ns:testMinorCompaction,,1689098116506.03ba78e07b3026a36a7cde3865422d82. 2023-07-11 17:55:29,473 INFO [Listener at localhost/43271] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/03ba78e07b3026a36a7cde3865422d82/family1/1390f2e0215b46e7a68e4dc062e659b8, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/03ba78e07b3026a36a7cde3865422d82/family1/b2b73bd5c52247e595d119beceaaa7da, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/03ba78e07b3026a36a7cde3865422d82/family1/1fd8fbb361b54a4094d71bf39dc06a1f, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/03ba78e07b3026a36a7cde3865422d82/family1/064565ef2fce48c186b3534d3abed61f, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/03ba78e07b3026a36a7cde3865422d82/family1/c45740a2459c4b98a37397be8fe54742] into tmpdir=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/03ba78e07b3026a36a7cde3865422d82/.tmp, totalSize=26.6 K 2023-07-11 17:55:29,473 DEBUG [Listener at localhost/43271] compactions.Compactor(207): Compacting 1390f2e0215b46e7a68e4dc062e659b8, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1689098118633 2023-07-11 17:55:29,473 DEBUG [Listener at localhost/43271] compactions.Compactor(207): Compacting b2b73bd5c52247e595d119beceaaa7da, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1689098120533 2023-07-11 17:55:29,474 DEBUG [Listener at localhost/43271] compactions.Compactor(207): Compacting 1fd8fbb361b54a4094d71bf39dc06a1f, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1689098122353 2023-07-11 17:55:29,474 DEBUG [Listener at localhost/43271] compactions.Compactor(207): Compacting 064565ef2fce48c186b3534d3abed61f, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1689098124140 2023-07-11 17:55:29,474 DEBUG [Listener at localhost/43271] compactions.Compactor(207): Compacting c45740a2459c4b98a37397be8fe54742, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-07-11 17:55:29,483 INFO [Listener at localhost/43271] throttle.PressureAwareThroughputController(145): 03ba78e07b3026a36a7cde3865422d82#family1#compaction#151 average throughput is 0.83 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-11 17:55:29,491 INFO [Listener at localhost/43271] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e2023071167a99cb25ce944419631a642c78cdab7_del 2023-07-11 17:55:29,491 INFO [Listener at localhost/43271] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023071167a99cb25ce944419631a642c78cdab7_del to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e2023071167a99cb25ce944419631a642c78cdab7_del 2023-07-11 17:55:29,542 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/4e4357287b129f0600b33397cb2004ec/family2/a01375ac3ddf4dc3aa1d32048125139d, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/4e4357287b129f0600b33397cb2004ec/family2/e0ef21c26c504235a1dd57bb8e8fc329, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/4e4357287b129f0600b33397cb2004ec/family2/9c317965b41b434592b4a629540e63fd, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/4e4357287b129f0600b33397cb2004ec/family2/b677676982ed4d659bb69aa975fe87c4, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/4e4357287b129f0600b33397cb2004ec/family2/921b70b7645c41b788ace170abc0db97] to archive 2023-07-11 17:55:29,543 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 17:55:29,545 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/4e4357287b129f0600b33397cb2004ec/family2/a01375ac3ddf4dc3aa1d32048125139d to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/ns/testMinorCompaction/4e4357287b129f0600b33397cb2004ec/family2/a01375ac3ddf4dc3aa1d32048125139d 2023-07-11 17:55:29,546 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/4e4357287b129f0600b33397cb2004ec/family2/e0ef21c26c504235a1dd57bb8e8fc329 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/ns/testMinorCompaction/4e4357287b129f0600b33397cb2004ec/family2/e0ef21c26c504235a1dd57bb8e8fc329 2023-07-11 17:55:29,548 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/4e4357287b129f0600b33397cb2004ec/family2/9c317965b41b434592b4a629540e63fd to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/ns/testMinorCompaction/4e4357287b129f0600b33397cb2004ec/family2/9c317965b41b434592b4a629540e63fd 2023-07-11 17:55:29,549 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/4e4357287b129f0600b33397cb2004ec/family2/b677676982ed4d659bb69aa975fe87c4 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/ns/testMinorCompaction/4e4357287b129f0600b33397cb2004ec/family2/b677676982ed4d659bb69aa975fe87c4 2023-07-11 17:55:29,550 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/4e4357287b129f0600b33397cb2004ec/family2/921b70b7645c41b788ace170abc0db97 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/ns/testMinorCompaction/4e4357287b129f0600b33397cb2004ec/family2/921b70b7645c41b788ace170abc0db97 2023-07-11 17:55:30,307 INFO [Listener at localhost/43271] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 84567b575a8844048fc477494a2932f8 2023-07-11 17:55:30,308 DEBUG [Listener at localhost/43271] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/03ba78e07b3026a36a7cde3865422d82/.tmp/family1/84567b575a8844048fc477494a2932f8 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/03ba78e07b3026a36a7cde3865422d82/family1/84567b575a8844048fc477494a2932f8 2023-07-11 17:55:30,311 INFO [Listener at localhost/43271] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 84567b575a8844048fc477494a2932f8 2023-07-11 17:55:30,312 INFO [Listener at localhost/43271] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 03ba78e07b3026a36a7cde3865422d82/family1 of 03ba78e07b3026a36a7cde3865422d82 into 84567b575a8844048fc477494a2932f8(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-11 17:55:30,312 DEBUG [Listener at localhost/43271] regionserver.HRegion(2289): Compaction status journal for 03ba78e07b3026a36a7cde3865422d82: 2023-07-11 17:55:30,312 DEBUG [Listener at localhost/43271] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-07-11 17:55:30,312 DEBUG [Listener at localhost/43271] regionserver.HStore(1912): 03ba78e07b3026a36a7cde3865422d82/family2 is initiating major compaction (all files) 2023-07-11 17:55:30,312 INFO [Listener at localhost/43271] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-11 17:55:30,312 INFO [Listener at localhost/43271] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-11 17:55:30,313 INFO [Listener at localhost/43271] regionserver.HRegion(2259): Starting compaction of 03ba78e07b3026a36a7cde3865422d82/family2 in ns:testMinorCompaction,,1689098116506.03ba78e07b3026a36a7cde3865422d82. 2023-07-11 17:55:30,313 INFO [Listener at localhost/43271] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/03ba78e07b3026a36a7cde3865422d82/family2/fba194464f3f4eb99ddfdf6adf2268a1, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/03ba78e07b3026a36a7cde3865422d82/family2/646e3275aff94060b1f3239386439c88, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/03ba78e07b3026a36a7cde3865422d82/family2/94e14858f91843e58f652bc083a2975c, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/03ba78e07b3026a36a7cde3865422d82/family2/6c43fe515e674717b27622d629dd2459, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/03ba78e07b3026a36a7cde3865422d82/family2/864f8336948a4be7bc4ea109d7a1fefb] into tmpdir=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/03ba78e07b3026a36a7cde3865422d82/.tmp, totalSize=25.3 K 2023-07-11 17:55:30,313 DEBUG [Listener at localhost/43271] compactions.Compactor(207): Compacting fba194464f3f4eb99ddfdf6adf2268a1, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1689098118633 2023-07-11 17:55:30,313 DEBUG [Listener at localhost/43271] compactions.Compactor(207): Compacting 646e3275aff94060b1f3239386439c88, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1689098120533 2023-07-11 17:55:30,314 DEBUG [Listener at localhost/43271] compactions.Compactor(207): Compacting 94e14858f91843e58f652bc083a2975c, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1689098122353 2023-07-11 17:55:30,314 DEBUG [Listener at localhost/43271] compactions.Compactor(207): Compacting 6c43fe515e674717b27622d629dd2459, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1689098124140 2023-07-11 17:55:30,314 DEBUG [Listener at localhost/43271] compactions.Compactor(207): Compacting 864f8336948a4be7bc4ea109d7a1fefb, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-07-11 17:55:30,322 INFO [Listener at localhost/43271] throttle.PressureAwareThroughputController(145): 03ba78e07b3026a36a7cde3865422d82#family2#compaction#152 average throughput is 0.51 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-11 17:55:30,337 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/03ba78e07b3026a36a7cde3865422d82/family1/1390f2e0215b46e7a68e4dc062e659b8, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/03ba78e07b3026a36a7cde3865422d82/family1/b2b73bd5c52247e595d119beceaaa7da, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/03ba78e07b3026a36a7cde3865422d82/family1/1fd8fbb361b54a4094d71bf39dc06a1f, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/03ba78e07b3026a36a7cde3865422d82/family1/064565ef2fce48c186b3534d3abed61f, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/03ba78e07b3026a36a7cde3865422d82/family1/c45740a2459c4b98a37397be8fe54742] to archive 2023-07-11 17:55:30,337 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 17:55:30,339 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/03ba78e07b3026a36a7cde3865422d82/family1/1390f2e0215b46e7a68e4dc062e659b8 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/ns/testMinorCompaction/03ba78e07b3026a36a7cde3865422d82/family1/1390f2e0215b46e7a68e4dc062e659b8 2023-07-11 17:55:30,339 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/03ba78e07b3026a36a7cde3865422d82/family1/b2b73bd5c52247e595d119beceaaa7da to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/ns/testMinorCompaction/03ba78e07b3026a36a7cde3865422d82/family1/b2b73bd5c52247e595d119beceaaa7da 2023-07-11 17:55:30,340 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/03ba78e07b3026a36a7cde3865422d82/family1/1fd8fbb361b54a4094d71bf39dc06a1f to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/ns/testMinorCompaction/03ba78e07b3026a36a7cde3865422d82/family1/1fd8fbb361b54a4094d71bf39dc06a1f 2023-07-11 17:55:30,341 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/03ba78e07b3026a36a7cde3865422d82/family1/064565ef2fce48c186b3534d3abed61f to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/ns/testMinorCompaction/03ba78e07b3026a36a7cde3865422d82/family1/064565ef2fce48c186b3534d3abed61f 2023-07-11 17:55:30,342 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/03ba78e07b3026a36a7cde3865422d82/family1/c45740a2459c4b98a37397be8fe54742 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/ns/testMinorCompaction/03ba78e07b3026a36a7cde3865422d82/family1/c45740a2459c4b98a37397be8fe54742 2023-07-11 17:55:30,730 INFO [Listener at localhost/43271] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e2023071155361f26666541b399fa0157733980bd_del 2023-07-11 17:55:30,731 INFO [Listener at localhost/43271] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023071155361f26666541b399fa0157733980bd_del to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e2023071155361f26666541b399fa0157733980bd_del 2023-07-11 17:55:31,544 INFO [Listener at localhost/43271] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a03c93878a9146ec89a1c80384775195 2023-07-11 17:55:31,545 DEBUG [Listener at localhost/43271] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/03ba78e07b3026a36a7cde3865422d82/.tmp/family2/a03c93878a9146ec89a1c80384775195 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/03ba78e07b3026a36a7cde3865422d82/family2/a03c93878a9146ec89a1c80384775195 2023-07-11 17:55:31,548 INFO [Listener at localhost/43271] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a03c93878a9146ec89a1c80384775195 2023-07-11 17:55:31,549 INFO [Listener at localhost/43271] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 03ba78e07b3026a36a7cde3865422d82/family2 of 03ba78e07b3026a36a7cde3865422d82 into a03c93878a9146ec89a1c80384775195(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-07-11 17:55:31,549 DEBUG [Listener at localhost/43271] regionserver.HRegion(2289): Compaction status journal for 03ba78e07b3026a36a7cde3865422d82: 2023-07-11 17:55:31,549 DEBUG [Listener at localhost/43271] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-07-11 17:55:31,549 DEBUG [Listener at localhost/43271] regionserver.HStore(1912): 32200e46ee32133355d305b07aa3b428/family1 is initiating major compaction (all files) 2023-07-11 17:55:31,549 INFO [Listener at localhost/43271] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-11 17:55:31,549 INFO [Listener at localhost/43271] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-11 17:55:31,550 INFO [Listener at localhost/43271] regionserver.HRegion(2259): Starting compaction of 32200e46ee32133355d305b07aa3b428/family1 in ns:testMinorCompaction,2,1689098116506.32200e46ee32133355d305b07aa3b428. 2023-07-11 17:55:31,550 INFO [Listener at localhost/43271] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/32200e46ee32133355d305b07aa3b428/family1/405bab82dfaa446aafc456e0b8ab6279, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/32200e46ee32133355d305b07aa3b428/family1/3f0789dba10b407fa8dea4d972b2be00, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/32200e46ee32133355d305b07aa3b428/family1/858e8606487c4a07931a6e9465d6ec7d, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/32200e46ee32133355d305b07aa3b428/family1/6bcbb1c91c4342cd90d7ceba1fea7a65, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/32200e46ee32133355d305b07aa3b428/family1/3e727df31c6e43a2840e9aa466b6dd8a] into tmpdir=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/32200e46ee32133355d305b07aa3b428/.tmp, totalSize=26.6 K 2023-07-11 17:55:31,550 DEBUG [Listener at localhost/43271] compactions.Compactor(207): Compacting 405bab82dfaa446aafc456e0b8ab6279, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1689098118634 2023-07-11 17:55:31,551 DEBUG [Listener at localhost/43271] compactions.Compactor(207): Compacting 3f0789dba10b407fa8dea4d972b2be00, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1689098120534 2023-07-11 17:55:31,551 DEBUG [Listener at localhost/43271] compactions.Compactor(207): Compacting 858e8606487c4a07931a6e9465d6ec7d, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1689098122354 2023-07-11 17:55:31,551 DEBUG [Listener at localhost/43271] compactions.Compactor(207): Compacting 6bcbb1c91c4342cd90d7ceba1fea7a65, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1689098124140 2023-07-11 17:55:31,551 DEBUG [Listener at localhost/43271] compactions.Compactor(207): Compacting 3e727df31c6e43a2840e9aa466b6dd8a, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-07-11 17:55:31,560 INFO [Listener at localhost/43271] throttle.PressureAwareThroughputController(145): 32200e46ee32133355d305b07aa3b428#family1#compaction#153 average throughput is 0.55 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-11 17:55:31,640 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/03ba78e07b3026a36a7cde3865422d82/family2/fba194464f3f4eb99ddfdf6adf2268a1, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/03ba78e07b3026a36a7cde3865422d82/family2/646e3275aff94060b1f3239386439c88, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/03ba78e07b3026a36a7cde3865422d82/family2/94e14858f91843e58f652bc083a2975c, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/03ba78e07b3026a36a7cde3865422d82/family2/6c43fe515e674717b27622d629dd2459, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/03ba78e07b3026a36a7cde3865422d82/family2/864f8336948a4be7bc4ea109d7a1fefb] to archive 2023-07-11 17:55:31,641 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 17:55:31,643 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/03ba78e07b3026a36a7cde3865422d82/family2/fba194464f3f4eb99ddfdf6adf2268a1 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/ns/testMinorCompaction/03ba78e07b3026a36a7cde3865422d82/family2/fba194464f3f4eb99ddfdf6adf2268a1 2023-07-11 17:55:31,645 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/03ba78e07b3026a36a7cde3865422d82/family2/646e3275aff94060b1f3239386439c88 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/ns/testMinorCompaction/03ba78e07b3026a36a7cde3865422d82/family2/646e3275aff94060b1f3239386439c88 2023-07-11 17:55:31,646 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/03ba78e07b3026a36a7cde3865422d82/family2/94e14858f91843e58f652bc083a2975c to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/ns/testMinorCompaction/03ba78e07b3026a36a7cde3865422d82/family2/94e14858f91843e58f652bc083a2975c 2023-07-11 17:55:31,647 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/03ba78e07b3026a36a7cde3865422d82/family2/6c43fe515e674717b27622d629dd2459 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/ns/testMinorCompaction/03ba78e07b3026a36a7cde3865422d82/family2/6c43fe515e674717b27622d629dd2459 2023-07-11 17:55:31,650 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/03ba78e07b3026a36a7cde3865422d82/family2/864f8336948a4be7bc4ea109d7a1fefb to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/ns/testMinorCompaction/03ba78e07b3026a36a7cde3865422d82/family2/864f8336948a4be7bc4ea109d7a1fefb 2023-07-11 17:55:31,968 INFO [Listener at localhost/43271] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202307118ea402ac5a3241b0878a330851b29bb2_del 2023-07-11 17:55:31,968 INFO [Listener at localhost/43271] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202307118ea402ac5a3241b0878a330851b29bb2_del to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202307118ea402ac5a3241b0878a330851b29bb2_del 2023-07-11 17:55:32,783 INFO [Listener at localhost/43271] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ea3700fee3194214883e91a3be8af08e 2023-07-11 17:55:32,784 DEBUG [Listener at localhost/43271] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/32200e46ee32133355d305b07aa3b428/.tmp/family1/ea3700fee3194214883e91a3be8af08e as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/32200e46ee32133355d305b07aa3b428/family1/ea3700fee3194214883e91a3be8af08e 2023-07-11 17:55:32,789 INFO [Listener at localhost/43271] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ea3700fee3194214883e91a3be8af08e 2023-07-11 17:55:32,790 INFO [Listener at localhost/43271] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 32200e46ee32133355d305b07aa3b428/family1 of 32200e46ee32133355d305b07aa3b428 into ea3700fee3194214883e91a3be8af08e(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-07-11 17:55:32,791 DEBUG [Listener at localhost/43271] regionserver.HRegion(2289): Compaction status journal for 32200e46ee32133355d305b07aa3b428: 2023-07-11 17:55:32,791 DEBUG [Listener at localhost/43271] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-07-11 17:55:32,791 DEBUG [Listener at localhost/43271] regionserver.HStore(1912): 32200e46ee32133355d305b07aa3b428/family2 is initiating major compaction (all files) 2023-07-11 17:55:32,791 INFO [Listener at localhost/43271] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-11 17:55:32,791 INFO [Listener at localhost/43271] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-11 17:55:32,794 INFO [Listener at localhost/43271] regionserver.HRegion(2259): Starting compaction of 32200e46ee32133355d305b07aa3b428/family2 in ns:testMinorCompaction,2,1689098116506.32200e46ee32133355d305b07aa3b428. 2023-07-11 17:55:32,794 INFO [Listener at localhost/43271] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/32200e46ee32133355d305b07aa3b428/family2/3629ded94de0471998b360504cdcbcdb, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/32200e46ee32133355d305b07aa3b428/family2/aa5de3bef0d8453db9f192998f7eb6c2, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/32200e46ee32133355d305b07aa3b428/family2/80ab816412f74471a0e48e682cbf8a6d, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/32200e46ee32133355d305b07aa3b428/family2/c205746f7134407583e99c2c2f354c94, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/32200e46ee32133355d305b07aa3b428/family2/8d13d36d1b084f548627b0b6602508ae] into tmpdir=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/32200e46ee32133355d305b07aa3b428/.tmp, totalSize=25.3 K 2023-07-11 17:55:32,795 DEBUG [Listener at localhost/43271] compactions.Compactor(207): Compacting 3629ded94de0471998b360504cdcbcdb, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1689098118634 2023-07-11 17:55:32,796 DEBUG [Listener at localhost/43271] compactions.Compactor(207): Compacting aa5de3bef0d8453db9f192998f7eb6c2, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1689098120534 2023-07-11 17:55:32,797 DEBUG [Listener at localhost/43271] compactions.Compactor(207): Compacting 80ab816412f74471a0e48e682cbf8a6d, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1689098122354 2023-07-11 17:55:32,798 DEBUG [Listener at localhost/43271] compactions.Compactor(207): Compacting c205746f7134407583e99c2c2f354c94, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1689098124140 2023-07-11 17:55:32,798 DEBUG [Listener at localhost/43271] compactions.Compactor(207): Compacting 8d13d36d1b084f548627b0b6602508ae, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-07-11 17:55:32,820 INFO [Listener at localhost/43271] throttle.PressureAwareThroughputController(145): 32200e46ee32133355d305b07aa3b428#family2#compaction#154 average throughput is 0.51 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-11 17:55:32,836 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/32200e46ee32133355d305b07aa3b428/family1/405bab82dfaa446aafc456e0b8ab6279, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/32200e46ee32133355d305b07aa3b428/family1/3f0789dba10b407fa8dea4d972b2be00, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/32200e46ee32133355d305b07aa3b428/family1/858e8606487c4a07931a6e9465d6ec7d, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/32200e46ee32133355d305b07aa3b428/family1/6bcbb1c91c4342cd90d7ceba1fea7a65, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/32200e46ee32133355d305b07aa3b428/family1/3e727df31c6e43a2840e9aa466b6dd8a] to archive 2023-07-11 17:55:32,837 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 17:55:32,839 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/32200e46ee32133355d305b07aa3b428/family1/405bab82dfaa446aafc456e0b8ab6279 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/ns/testMinorCompaction/32200e46ee32133355d305b07aa3b428/family1/405bab82dfaa446aafc456e0b8ab6279 2023-07-11 17:55:32,840 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/32200e46ee32133355d305b07aa3b428/family1/3f0789dba10b407fa8dea4d972b2be00 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/ns/testMinorCompaction/32200e46ee32133355d305b07aa3b428/family1/3f0789dba10b407fa8dea4d972b2be00 2023-07-11 17:55:32,841 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/32200e46ee32133355d305b07aa3b428/family1/858e8606487c4a07931a6e9465d6ec7d to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/ns/testMinorCompaction/32200e46ee32133355d305b07aa3b428/family1/858e8606487c4a07931a6e9465d6ec7d 2023-07-11 17:55:32,843 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/32200e46ee32133355d305b07aa3b428/family1/6bcbb1c91c4342cd90d7ceba1fea7a65 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/ns/testMinorCompaction/32200e46ee32133355d305b07aa3b428/family1/6bcbb1c91c4342cd90d7ceba1fea7a65 2023-07-11 17:55:32,844 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/32200e46ee32133355d305b07aa3b428/family1/3e727df31c6e43a2840e9aa466b6dd8a to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/ns/testMinorCompaction/32200e46ee32133355d305b07aa3b428/family1/3e727df31c6e43a2840e9aa466b6dd8a 2023-07-11 17:55:33,231 INFO [Listener at localhost/43271] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202307111be53fdcea6a44f4aa3d5931bc2b4471_del 2023-07-11 17:55:33,231 INFO [Listener at localhost/43271] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202307111be53fdcea6a44f4aa3d5931bc2b4471_del to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c202307111be53fdcea6a44f4aa3d5931bc2b4471_del 2023-07-11 17:55:33,243 INFO [Listener at localhost/43271] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 571ca9c7946e4977ab0c3a2a3d74c625 2023-07-11 17:55:33,244 DEBUG [Listener at localhost/43271] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/32200e46ee32133355d305b07aa3b428/.tmp/family2/571ca9c7946e4977ab0c3a2a3d74c625 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/32200e46ee32133355d305b07aa3b428/family2/571ca9c7946e4977ab0c3a2a3d74c625 2023-07-11 17:55:33,247 INFO [Listener at localhost/43271] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 571ca9c7946e4977ab0c3a2a3d74c625 2023-07-11 17:55:33,248 INFO [Listener at localhost/43271] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 32200e46ee32133355d305b07aa3b428/family2 of 32200e46ee32133355d305b07aa3b428 into 571ca9c7946e4977ab0c3a2a3d74c625(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-11 17:55:33,248 DEBUG [Listener at localhost/43271] regionserver.HRegion(2289): Compaction status journal for 32200e46ee32133355d305b07aa3b428: 2023-07-11 17:55:33,251 DEBUG [Listener at localhost/43271] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-07-11 17:55:33,254 DEBUG [Listener at localhost/43271] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-07-11 17:55:33,257 DEBUG [Listener at localhost/43271] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-07-11 17:55:33,258 DEBUG [Listener at localhost/43271] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-07-11 17:55:33,263 INFO [Listener at localhost/43271] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-07-11 17:55:33,275 INFO [Listener at localhost/43271] compactions.PartitionedMobCompactor(306): The compaction type is PART_FILES, the request has 3 del files, 3 selected files, and 0 irrelevant files table 'ns:testMinorCompaction' and column 'family1' 2023-07-11 17:55:33,278 INFO [Listener at localhost/43271] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e2023071167a99cb25ce944419631a642c78cdab7_del 2023-07-11 17:55:33,280 INFO [Listener at localhost/43271] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230711b3d24d7cc8424bf4b90a6c8413054394_del 2023-07-11 17:55:33,284 INFO [Listener at localhost/43271] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202307118ea402ac5a3241b0878a330851b29bb2_del 2023-07-11 17:55:33,284 INFO [Listener at localhost/43271] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='ns:testMinorCompaction' column='family1' 2023-07-11 17:55:33,284 DEBUG [Listener at localhost/43271] zookeeper.ReadOnlyZKClient(139): Connect 0x5208d8f8 to 127.0.0.1:50702 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 17:55:33,291 DEBUG [Listener at localhost/43271] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@35c97728, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 17:55:33,292 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230711 for table='ns:testMinorCompaction' and column='family1' 2023-07-11 17:55:33,292 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20230711 for table='ns:testMinorCompaction' and column='family1' 2023-07-11 17:55:33,292 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230711 for table='ns:testMinorCompaction' and column='family1' 2023-07-11 17:55:33,336 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/32200e46ee32133355d305b07aa3b428/family2/3629ded94de0471998b360504cdcbcdb, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/32200e46ee32133355d305b07aa3b428/family2/aa5de3bef0d8453db9f192998f7eb6c2, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/32200e46ee32133355d305b07aa3b428/family2/80ab816412f74471a0e48e682cbf8a6d, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/32200e46ee32133355d305b07aa3b428/family2/c205746f7134407583e99c2c2f354c94, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/32200e46ee32133355d305b07aa3b428/family2/8d13d36d1b084f548627b0b6602508ae] to archive 2023-07-11 17:55:33,337 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 17:55:33,338 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/32200e46ee32133355d305b07aa3b428/family2/3629ded94de0471998b360504cdcbcdb to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/ns/testMinorCompaction/32200e46ee32133355d305b07aa3b428/family2/3629ded94de0471998b360504cdcbcdb 2023-07-11 17:55:33,339 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/32200e46ee32133355d305b07aa3b428/family2/aa5de3bef0d8453db9f192998f7eb6c2 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/ns/testMinorCompaction/32200e46ee32133355d305b07aa3b428/family2/aa5de3bef0d8453db9f192998f7eb6c2 2023-07-11 17:55:33,340 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/32200e46ee32133355d305b07aa3b428/family2/80ab816412f74471a0e48e682cbf8a6d to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/ns/testMinorCompaction/32200e46ee32133355d305b07aa3b428/family2/80ab816412f74471a0e48e682cbf8a6d 2023-07-11 17:55:33,341 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/32200e46ee32133355d305b07aa3b428/family2/c205746f7134407583e99c2c2f354c94 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/ns/testMinorCompaction/32200e46ee32133355d305b07aa3b428/family2/c205746f7134407583e99c2c2f354c94 2023-07-11 17:55:33,342 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/32200e46ee32133355d305b07aa3b428/family2/8d13d36d1b084f548627b0b6602508ae to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/ns/testMinorCompaction/32200e46ee32133355d305b07aa3b428/family2/8d13d36d1b084f548627b0b6602508ae 2023-07-11 17:55:33,734 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230711e47d4978eebd4c998f1ed0b0be16ffd6 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20230711e47d4978eebd4c998f1ed0b0be16ffd6 2023-07-11 17:55:33,735 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230711 table='ns:testMinorCompaction' column='family1' 2023-07-11 17:55:33,735 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230711f7ed96414d974e7ea265094dabeca2e0 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230711f7ed96414d974e7ea265094dabeca2e0 2023-07-11 17:55:33,736 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230711 table='ns:testMinorCompaction' column='family1' 2023-07-11 17:55:33,751 DEBUG [MobFileCompactionChore-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 17:55:33,758 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:58354, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 17:55:33,770 DEBUG [MobFileCompactionChore-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-11 17:55:33,776 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:60976, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-11 17:55:33,805 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230711/family1/5f95c20cafbd4cceaafe57758bcf335f first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x01] 2023-07-11 17:55:33,806 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=ns:testMinorCompaction,1,1689098116506.4e4357287b129f0600b33397cb2004ec., hostname=jenkins-hbase9.apache.org,45839,1689097999112, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230711/family1/5f95c20cafbd4cceaafe57758bcf335f}] 2023-07-11 17:55:33,807 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230711/family1/060c1642c1bb4dc990cf1320142cdb57 first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x01] 2023-07-11 17:55:33,815 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=ns:testMinorCompaction,,1689098116506.03ba78e07b3026a36a7cde3865422d82., hostname=jenkins-hbase9.apache.org,45839,1689097999112, seqNum=2 for row with hfile group [{family1,hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230711/family1/060c1642c1bb4dc990cf1320142cdb57}] 2023-07-11 17:55:33,820 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(763): Validating hfile at hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230711/family1/5f95c20cafbd4cceaafe57758bcf335f for inclusion in 4e4357287b129f0600b33397cb2004ec/family1 2023-07-11 17:55:33,821 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45839] regionserver.HStore(763): Validating hfile at hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230711/family1/060c1642c1bb4dc990cf1320142cdb57 for inclusion in 03ba78e07b3026a36a7cde3865422d82/family1 2023-07-11 17:55:33,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x01 2023-07-11 17:55:33,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(777): Region bounds: first=1 last=2 2023-07-11 17:55:33,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HRegion(2446): Flush status journal for 4e4357287b129f0600b33397cb2004ec: 2023-07-11 17:55:33,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45839] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x01 2023-07-11 17:55:33,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45839] regionserver.HStore(777): Region bounds: first= last=1 2023-07-11 17:55:33,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45839] regionserver.HRegion(2446): Flush status journal for 03ba78e07b3026a36a7cde3865422d82: 2023-07-11 17:55:33,825 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230711/family1/5f95c20cafbd4cceaafe57758bcf335f to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__ns_testMinorCompaction__maar6dnuch8lvmj7eg5vb5mcnclecs9bosfoj1scn32bigsh6hf0g3aq36j1nb99/family1/5f95c20cafbd4cceaafe57758bcf335f 2023-07-11 17:55:33,825 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45839] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230711/family1/060c1642c1bb4dc990cf1320142cdb57 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__ns_testMinorCompaction__thh57jq0g7l8m2122pipqcpgvh2n87svqslds8isnff7mebmlc1r5gls64qo4hv0/family1/060c1642c1bb4dc990cf1320142cdb57 2023-07-11 17:55:33,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45839] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__ns_testMinorCompaction__thh57jq0g7l8m2122pipqcpgvh2n87svqslds8isnff7mebmlc1r5gls64qo4hv0/family1/060c1642c1bb4dc990cf1320142cdb57 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/03ba78e07b3026a36a7cde3865422d82/family1/b2c24823f8914df8b7d2993346f297c9_SeqId_28_ 2023-07-11 17:55:33,830 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45839] regionserver.HStore(849): Loaded HFile hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__ns_testMinorCompaction__thh57jq0g7l8m2122pipqcpgvh2n87svqslds8isnff7mebmlc1r5gls64qo4hv0/family1/060c1642c1bb4dc990cf1320142cdb57 into 03ba78e07b3026a36a7cde3865422d82/family1 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/03ba78e07b3026a36a7cde3865422d82/family1/b2c24823f8914df8b7d2993346f297c9_SeqId_28_ - updating store file list. 2023-07-11 17:55:33,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__ns_testMinorCompaction__maar6dnuch8lvmj7eg5vb5mcnclecs9bosfoj1scn32bigsh6hf0g3aq36j1nb99/family1/5f95c20cafbd4cceaafe57758bcf335f as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/4e4357287b129f0600b33397cb2004ec/family1/2f5904a1d00a442f80b268f0af5f2aba_SeqId_28_ 2023-07-11 17:55:33,832 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(849): Loaded HFile hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__ns_testMinorCompaction__maar6dnuch8lvmj7eg5vb5mcnclecs9bosfoj1scn32bigsh6hf0g3aq36j1nb99/family1/5f95c20cafbd4cceaafe57758bcf335f into 4e4357287b129f0600b33397cb2004ec/family1 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/4e4357287b129f0600b33397cb2004ec/family1/2f5904a1d00a442f80b268f0af5f2aba_SeqId_28_ - updating store file list. 2023-07-11 17:55:33,837 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45839] regionserver.HStore(882): Loaded HFile hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/03ba78e07b3026a36a7cde3865422d82/family1/b2c24823f8914df8b7d2993346f297c9_SeqId_28_ into 03ba78e07b3026a36a7cde3865422d82/family1 2023-07-11 17:55:33,837 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45839] regionserver.HStore(855): Successfully loaded hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__ns_testMinorCompaction__thh57jq0g7l8m2122pipqcpgvh2n87svqslds8isnff7mebmlc1r5gls64qo4hv0/family1/060c1642c1bb4dc990cf1320142cdb57 into 03ba78e07b3026a36a7cde3865422d82/family1 (new location: hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/03ba78e07b3026a36a7cde3865422d82/family1/b2c24823f8914df8b7d2993346f297c9_SeqId_28_) 2023-07-11 17:55:33,837 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(882): Loaded HFile hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/4e4357287b129f0600b33397cb2004ec/family1/2f5904a1d00a442f80b268f0af5f2aba_SeqId_28_ into 4e4357287b129f0600b33397cb2004ec/family1 2023-07-11 17:55:33,837 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(855): Successfully loaded hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__ns_testMinorCompaction__maar6dnuch8lvmj7eg5vb5mcnclecs9bosfoj1scn32bigsh6hf0g3aq36j1nb99/family1/5f95c20cafbd4cceaafe57758bcf335f into 4e4357287b129f0600b33397cb2004ec/family1 (new location: hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/4e4357287b129f0600b33397cb2004ec/family1/2f5904a1d00a442f80b268f0af5f2aba_SeqId_28_) 2023-07-11 17:55:33,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45839] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__ns_testMinorCompaction__thh57jq0g7l8m2122pipqcpgvh2n87svqslds8isnff7mebmlc1r5gls64qo4hv0/family1/060c1642c1bb4dc990cf1320142cdb57 2023-07-11 17:55:33,840 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230711 table='ns:testMinorCompaction' column='family1' 2023-07-11 17:55:33,840 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 17:55:33,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__ns_testMinorCompaction__maar6dnuch8lvmj7eg5vb5mcnclecs9bosfoj1scn32bigsh6hf0g3aq36j1nb99/family1/5f95c20cafbd4cceaafe57758bcf335f 2023-07-11 17:55:33,842 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e2023071116b4042f6d2046cdbb469dfb99dbe45d to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e2023071116b4042f6d2046cdbb469dfb99dbe45d 2023-07-11 17:55:33,842 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-07-11 17:55:33,843 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230711' 2023-07-11 17:55:33,843 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230711 for table='ns:testMinorCompaction' and column='family1' 2023-07-11 17:55:33,843 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230711 table='ns:testMinorCompaction' column='family1' 2023-07-11 17:55:33,844 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 17:55:33,847 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b2023071134f0a592ca1a4576abe13ad0225aea32 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b2023071134f0a592ca1a4576abe13ad0225aea32 2023-07-11 17:55:33,847 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-07-11 17:55:33,847 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230711' 2023-07-11 17:55:33,848 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20230711 for table='ns:testMinorCompaction' and column='family1' 2023-07-11 17:55:34,134 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230711f5809f71033c48198eb9c81a85d4ffa9 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20230711f5809f71033c48198eb9c81a85d4ffa9 2023-07-11 17:55:34,135 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230711 table='ns:testMinorCompaction' column='family1' 2023-07-11 17:55:34,157 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230711/family1/18c8b485e13b486eb1b34207484a1741 first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x01] 2023-07-11 17:55:34,158 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=ns:testMinorCompaction,2,1689098116506.32200e46ee32133355d305b07aa3b428., hostname=jenkins-hbase9.apache.org,45839,1689097999112, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230711/family1/18c8b485e13b486eb1b34207484a1741}] 2023-07-11 17:55:34,160 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(763): Validating hfile at hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230711/family1/18c8b485e13b486eb1b34207484a1741 for inclusion in 32200e46ee32133355d305b07aa3b428/family1 2023-07-11 17:55:34,162 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x01 2023-07-11 17:55:34,162 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(777): Region bounds: first=2 last= 2023-07-11 17:55:34,162 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HRegion(2446): Flush status journal for 32200e46ee32133355d305b07aa3b428: 2023-07-11 17:55:34,163 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230711/family1/18c8b485e13b486eb1b34207484a1741 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__ns_testMinorCompaction__48928dkjratoem37mg4h6tkcs045vabeobbp36gojjpg3dekhiq2iqs8b020auv5/family1/18c8b485e13b486eb1b34207484a1741 2023-07-11 17:55:34,165 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__ns_testMinorCompaction__48928dkjratoem37mg4h6tkcs045vabeobbp36gojjpg3dekhiq2iqs8b020auv5/family1/18c8b485e13b486eb1b34207484a1741 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/32200e46ee32133355d305b07aa3b428/family1/aad78e6d8bb14ca28a0c1672ddecf01d_SeqId_28_ 2023-07-11 17:55:34,165 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(849): Loaded HFile hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__ns_testMinorCompaction__48928dkjratoem37mg4h6tkcs045vabeobbp36gojjpg3dekhiq2iqs8b020auv5/family1/18c8b485e13b486eb1b34207484a1741 into 32200e46ee32133355d305b07aa3b428/family1 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/32200e46ee32133355d305b07aa3b428/family1/aad78e6d8bb14ca28a0c1672ddecf01d_SeqId_28_ - updating store file list. 2023-07-11 17:55:34,168 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(882): Loaded HFile hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/32200e46ee32133355d305b07aa3b428/family1/aad78e6d8bb14ca28a0c1672ddecf01d_SeqId_28_ into 32200e46ee32133355d305b07aa3b428/family1 2023-07-11 17:55:34,168 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(855): Successfully loaded hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__ns_testMinorCompaction__48928dkjratoem37mg4h6tkcs045vabeobbp36gojjpg3dekhiq2iqs8b020auv5/family1/18c8b485e13b486eb1b34207484a1741 into 32200e46ee32133355d305b07aa3b428/family1 (new location: hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/32200e46ee32133355d305b07aa3b428/family1/aad78e6d8bb14ca28a0c1672ddecf01d_SeqId_28_) 2023-07-11 17:55:34,168 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__ns_testMinorCompaction__48928dkjratoem37mg4h6tkcs045vabeobbp36gojjpg3dekhiq2iqs8b020auv5/family1/18c8b485e13b486eb1b34207484a1741 2023-07-11 17:55:34,170 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230711 table='ns:testMinorCompaction' column='family1' 2023-07-11 17:55:34,171 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 17:55:34,172 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20230711ecbe7db5de5f415b8e48ed76177de75e to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20230711ecbe7db5de5f415b8e48ed76177de75e 2023-07-11 17:55:34,172 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-07-11 17:55:34,172 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230711' 2023-07-11 17:55:34,172 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230711 for table='ns:testMinorCompaction' and column='family1' 2023-07-11 17:55:34,173 INFO [Listener at localhost/43271] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='ns:testMinorCompaction' column='family1' 2023-07-11 17:55:34,174 DEBUG [Listener at localhost/43271] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-07-11 17:55:34,176 DEBUG [Listener at localhost/43271] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-07-11 17:55:34,178 DEBUG [Listener at localhost/43271] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-07-11 17:55:34,179 DEBUG [Listener at localhost/43271] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-07-11 17:55:34,195 INFO [Listener at localhost/43271] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompaction Thread=258 (was 292), OpenFileDescriptor=652 (was 754), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=295 (was 271) - SystemLoadAverage LEAK? -, ProcessCount=170 (was 170), AvailableMemoryMB=8044 (was 8505) 2023-07-11 17:55:34,207 INFO [Listener at localhost/43271] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompactionWithMonthlyPolicy Thread=258, OpenFileDescriptor=652, MaxFileDescriptor=60000, SystemLoadAverage=295, ProcessCount=170, AvailableMemoryMB=8044 2023-07-11 17:55:34,209 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testMinorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-07-11 17:55:34,209 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:34,211 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-07-11 17:55:34,211 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testMinorCompactionWithMonthlyPolicy" procId is: 112 2023-07-11 17:55:34,211 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-11 17:55:34,212 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-07-11 17:55:34,213 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/797d03d17f9b32921e56ea87bcf5ae5e 2023-07-11 17:55:34,213 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/797d03d17f9b32921e56ea87bcf5ae5e empty. 2023-07-11 17:55:34,214 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/797d03d17f9b32921e56ea87bcf5ae5e 2023-07-11 17:55:34,214 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testMinorCompactionWithMonthlyPolicy regions 2023-07-11 17:55:34,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-07-11 17:55:34,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-07-11 17:55:34,621 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/.tabledesc/.tableinfo.0000000001 2023-07-11 17:55:34,622 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => 797d03d17f9b32921e56ea87bcf5ae5e, NAME => 'testMinorCompactionWithMonthlyPolicy,,1689098134208.797d03d17f9b32921e56ea87bcf5ae5e.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMinorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}, regionDir=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/.tmp 2023-07-11 17:55:34,815 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-07-11 17:55:34,850 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-11 17:55:34,850 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x57fc0dea to 127.0.0.1:50702 2023-07-11 17:55:34,850 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 17:55:34,851 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-11 17:55:34,851 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0fe0a3cf to 127.0.0.1:50702 2023-07-11 17:55:34,851 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 17:55:34,852 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-11 17:55:34,853 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5208d8f8 to 127.0.0.1:50702 2023-07-11 17:55:34,853 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 17:55:35,027 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithMonthlyPolicy,,1689098134208.797d03d17f9b32921e56ea87bcf5ae5e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 17:55:35,027 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1604): Closing 797d03d17f9b32921e56ea87bcf5ae5e, disabling compactions & flushes 2023-07-11 17:55:35,027 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithMonthlyPolicy,,1689098134208.797d03d17f9b32921e56ea87bcf5ae5e. 2023-07-11 17:55:35,027 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithMonthlyPolicy,,1689098134208.797d03d17f9b32921e56ea87bcf5ae5e. 2023-07-11 17:55:35,027 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithMonthlyPolicy,,1689098134208.797d03d17f9b32921e56ea87bcf5ae5e. after waiting 0 ms 2023-07-11 17:55:35,027 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithMonthlyPolicy,,1689098134208.797d03d17f9b32921e56ea87bcf5ae5e. 2023-07-11 17:55:35,027 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1838): Closed testMinorCompactionWithMonthlyPolicy,,1689098134208.797d03d17f9b32921e56ea87bcf5ae5e. 2023-07-11 17:55:35,027 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for 797d03d17f9b32921e56ea87bcf5ae5e: 2023-07-11 17:55:35,030 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-07-11 17:55:35,031 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMinorCompactionWithMonthlyPolicy,,1689098134208.797d03d17f9b32921e56ea87bcf5ae5e.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1689098135031"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689098135031"}]},"ts":"1689098135031"} 2023-07-11 17:55:35,032 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-11 17:55:35,033 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-11 17:55:35,033 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689098135033"}]},"ts":"1689098135033"} 2023-07-11 17:55:35,034 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithMonthlyPolicy, state=ENABLING in hbase:meta 2023-07-11 17:55:35,037 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=797d03d17f9b32921e56ea87bcf5ae5e, ASSIGN}] 2023-07-11 17:55:35,038 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=797d03d17f9b32921e56ea87bcf5ae5e, ASSIGN 2023-07-11 17:55:35,039 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=797d03d17f9b32921e56ea87bcf5ae5e, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,45839,1689097999112; forceNewPlan=false, retain=false 2023-07-11 17:55:35,190 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=113 updating hbase:meta row=797d03d17f9b32921e56ea87bcf5ae5e, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:35,190 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMinorCompactionWithMonthlyPolicy,,1689098134208.797d03d17f9b32921e56ea87bcf5ae5e.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1689098135190"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689098135190"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689098135190"}]},"ts":"1689098135190"} 2023-07-11 17:55:35,192 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=114, ppid=113, state=RUNNABLE; OpenRegionProcedure 797d03d17f9b32921e56ea87bcf5ae5e, server=jenkins-hbase9.apache.org,45839,1689097999112}] 2023-07-11 17:55:35,316 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-07-11 17:55:35,346 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testMinorCompactionWithMonthlyPolicy,,1689098134208.797d03d17f9b32921e56ea87bcf5ae5e. 2023-07-11 17:55:35,346 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 797d03d17f9b32921e56ea87bcf5ae5e, NAME => 'testMinorCompactionWithMonthlyPolicy,,1689098134208.797d03d17f9b32921e56ea87bcf5ae5e.', STARTKEY => '', ENDKEY => ''} 2023-07-11 17:55:35,346 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompactionWithMonthlyPolicy 797d03d17f9b32921e56ea87bcf5ae5e 2023-07-11 17:55:35,346 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithMonthlyPolicy,,1689098134208.797d03d17f9b32921e56ea87bcf5ae5e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 17:55:35,346 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 797d03d17f9b32921e56ea87bcf5ae5e 2023-07-11 17:55:35,346 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 797d03d17f9b32921e56ea87bcf5ae5e 2023-07-11 17:55:35,347 INFO [StoreOpener-797d03d17f9b32921e56ea87bcf5ae5e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 797d03d17f9b32921e56ea87bcf5ae5e 2023-07-11 17:55:35,349 DEBUG [StoreOpener-797d03d17f9b32921e56ea87bcf5ae5e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithMonthlyPolicy/797d03d17f9b32921e56ea87bcf5ae5e/family1 2023-07-11 17:55:35,349 DEBUG [StoreOpener-797d03d17f9b32921e56ea87bcf5ae5e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithMonthlyPolicy/797d03d17f9b32921e56ea87bcf5ae5e/family1 2023-07-11 17:55:35,349 INFO [StoreOpener-797d03d17f9b32921e56ea87bcf5ae5e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 797d03d17f9b32921e56ea87bcf5ae5e columnFamilyName family1 2023-07-11 17:55:35,351 INFO [StoreOpener-797d03d17f9b32921e56ea87bcf5ae5e-1] regionserver.HStore(310): Store=797d03d17f9b32921e56ea87bcf5ae5e/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 17:55:35,352 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithMonthlyPolicy/797d03d17f9b32921e56ea87bcf5ae5e 2023-07-11 17:55:35,352 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithMonthlyPolicy/797d03d17f9b32921e56ea87bcf5ae5e 2023-07-11 17:55:35,354 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 797d03d17f9b32921e56ea87bcf5ae5e 2023-07-11 17:55:35,356 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithMonthlyPolicy/797d03d17f9b32921e56ea87bcf5ae5e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 17:55:35,356 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 797d03d17f9b32921e56ea87bcf5ae5e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60217868, jitterRate=-0.10268384218215942}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 17:55:35,356 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 797d03d17f9b32921e56ea87bcf5ae5e: 2023-07-11 17:55:35,357 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMinorCompactionWithMonthlyPolicy,,1689098134208.797d03d17f9b32921e56ea87bcf5ae5e., pid=114, masterSystemTime=1689098135343 2023-07-11 17:55:35,358 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMinorCompactionWithMonthlyPolicy,,1689098134208.797d03d17f9b32921e56ea87bcf5ae5e. 2023-07-11 17:55:35,358 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testMinorCompactionWithMonthlyPolicy,,1689098134208.797d03d17f9b32921e56ea87bcf5ae5e. 2023-07-11 17:55:35,358 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=113 updating hbase:meta row=797d03d17f9b32921e56ea87bcf5ae5e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:35,359 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMinorCompactionWithMonthlyPolicy,,1689098134208.797d03d17f9b32921e56ea87bcf5ae5e.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1689098135358"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689098135358"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689098135358"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689098135358"}]},"ts":"1689098135358"} 2023-07-11 17:55:35,361 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=114, resume processing ppid=113 2023-07-11 17:55:35,361 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=114, ppid=113, state=SUCCESS; OpenRegionProcedure 797d03d17f9b32921e56ea87bcf5ae5e, server=jenkins-hbase9.apache.org,45839,1689097999112 in 168 msec 2023-07-11 17:55:35,362 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=113, resume processing ppid=112 2023-07-11 17:55:35,362 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=113, ppid=112, state=SUCCESS; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=797d03d17f9b32921e56ea87bcf5ae5e, ASSIGN in 324 msec 2023-07-11 17:55:35,363 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-11 17:55:35,363 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689098135363"}]},"ts":"1689098135363"} 2023-07-11 17:55:35,364 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithMonthlyPolicy, state=ENABLED in hbase:meta 2023-07-11 17:55:35,366 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-07-11 17:55:35,367 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy in 1.1570 sec 2023-07-11 17:55:36,317 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-07-11 17:55:36,317 INFO [Listener at localhost/43271] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMinorCompactionWithMonthlyPolicy, procId: 112 completed 2023-07-11 17:55:36,334 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 17:55:36,335 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:36,336 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-07-11 17:55:36,336 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:55:36,336 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-07-11 17:55:36,336 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-07-11 17:55:36,336 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:36,336 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:36,337 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:55:36,337 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:36,338 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:55:36,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:55:36,338 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:36,338 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 17:55:36,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:36,338 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:36,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 17:55:36,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:36,339 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:36,344 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:36,344 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-07-11 17:55:36,344 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:55:36,344 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-07-11 17:55:36,344 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 17:55:36,344 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 17:55:36,344 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1689098134208.797d03d17f9b32921e56ea87bcf5ae5e. 2023-07-11 17:55:36,344 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1689098134208.797d03d17f9b32921e56ea87bcf5ae5e. started... 2023-07-11 17:55:36,345 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 797d03d17f9b32921e56ea87bcf5ae5e 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-07-11 17:55:36,767 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015113032c4dde36df843758d49bc6a714affdd to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015113032c4dde36df843758d49bc6a714affdd 2023-07-11 17:55:37,171 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithMonthlyPolicy/797d03d17f9b32921e56ea87bcf5ae5e/.tmp/family1/b74660833a834ba78475d944b74cc753 2023-07-11 17:55:37,176 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithMonthlyPolicy/797d03d17f9b32921e56ea87bcf5ae5e/.tmp/family1/b74660833a834ba78475d944b74cc753 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithMonthlyPolicy/797d03d17f9b32921e56ea87bcf5ae5e/family1/b74660833a834ba78475d944b74cc753 2023-07-11 17:55:37,179 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithMonthlyPolicy/797d03d17f9b32921e56ea87bcf5ae5e/family1/b74660833a834ba78475d944b74cc753, entries=1000, sequenceid=5, filesize=166.0 K 2023-07-11 17:55:37,180 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 797d03d17f9b32921e56ea87bcf5ae5e in 835ms, sequenceid=5, compaction requested=false 2023-07-11 17:55:37,180 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMinorCompactionWithMonthlyPolicy' 2023-07-11 17:55:37,181 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 797d03d17f9b32921e56ea87bcf5ae5e: 2023-07-11 17:55:37,181 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1689098134208.797d03d17f9b32921e56ea87bcf5ae5e. 2023-07-11 17:55:37,181 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 17:55:37,181 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 17:55:37,181 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:37,181 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-07-11 17:55:37,181 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-07-11 17:55:37,182 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:37,182 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:37,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:37,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:55:37,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:55:37,183 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:37,183 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 17:55:37,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:55:37,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:55:37,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:37,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:37,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:55:37,184 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-07-11 17:55:37,184 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5c3a033d[Count = 0] remaining members to acquire global barrier 2023-07-11 17:55:37,184 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-07-11 17:55:37,184 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:37,185 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:37,185 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:37,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:37,185 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-07-11 17:55:37,185 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-07-11 17:55:37,185 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:37,186 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 17:55:37,185 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase9.apache.org,45839,1689097999112' in zk 2023-07-11 17:55:37,188 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-07-11 17:55:37,188 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:55:37,188 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:37,188 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-07-11 17:55:37,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:37,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:55:37,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:55:37,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:55:37,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:55:37,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:37,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:37,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:55:37,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:37,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:37,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase9.apache.org,45839,1689097999112': 2023-07-11 17:55:37,190 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-07-11 17:55:37,193 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-07-11 17:55:37,193 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 17:55:37,193 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 17:55:37,193 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:37,193 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 17:55:37,195 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:37,195 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:37,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:37,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:55:37,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:55:37,195 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:37,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:37,195 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:55:37,195 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:55:37,195 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:37,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:55:37,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:55:37,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:37,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:37,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:55:37,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:37,197 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:37,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:37,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:55:37,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:37,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:37,199 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:55:37,199 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:37,199 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:55:37,199 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-07-11 17:55:37,199 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 17:55:37,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:55:37,199 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:55:37,199 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:37,199 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:37,199 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-07-11 17:55:37,199 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:55:37,199 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:37,199 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:37,199 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:37,199 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-07-11 17:55:37,199 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:37,199 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:55:37,199 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 17:55:37,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:55:37,299 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 17:55:37,300 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 17:55:37,304 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 17:55:37,305 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-07-11 17:55:37,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:37,306 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-07-11 17:55:37,306 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:55:37,306 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-07-11 17:55:37,306 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-07-11 17:55:37,306 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:37,306 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:37,307 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:37,307 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:55:37,307 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:55:37,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:55:37,308 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:37,308 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 17:55:37,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:37,308 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:37,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 17:55:37,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:37,308 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:37,309 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-07-11 17:55:37,309 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:37,309 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-07-11 17:55:37,309 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:55:37,309 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-07-11 17:55:37,309 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 17:55:37,309 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 17:55:37,309 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1689098134208.797d03d17f9b32921e56ea87bcf5ae5e. 2023-07-11 17:55:37,309 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1689098134208.797d03d17f9b32921e56ea87bcf5ae5e. started... 2023-07-11 17:55:37,309 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 797d03d17f9b32921e56ea87bcf5ae5e 1/1 column families, dataSize=74 B heapSize=408 B 2023-07-11 17:55:37,721 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511282d3ef57148c341fb8870f71e8c68dbe5 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511282d3ef57148c341fb8870f71e8c68dbe5 2023-07-11 17:55:38,126 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithMonthlyPolicy/797d03d17f9b32921e56ea87bcf5ae5e/.tmp/family1/e4917da2ac564678ae1cfcd0f6fa34e1 2023-07-11 17:55:38,130 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithMonthlyPolicy/797d03d17f9b32921e56ea87bcf5ae5e/.tmp/family1/e4917da2ac564678ae1cfcd0f6fa34e1 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithMonthlyPolicy/797d03d17f9b32921e56ea87bcf5ae5e/family1/e4917da2ac564678ae1cfcd0f6fa34e1 2023-07-11 17:55:38,133 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithMonthlyPolicy/797d03d17f9b32921e56ea87bcf5ae5e/family1/e4917da2ac564678ae1cfcd0f6fa34e1, entries=1, sequenceid=9, filesize=5.0 K 2023-07-11 17:55:38,134 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 797d03d17f9b32921e56ea87bcf5ae5e in 825ms, sequenceid=9, compaction requested=false 2023-07-11 17:55:38,134 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 797d03d17f9b32921e56ea87bcf5ae5e: 2023-07-11 17:55:38,134 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1689098134208.797d03d17f9b32921e56ea87bcf5ae5e. 2023-07-11 17:55:38,134 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 17:55:38,135 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 17:55:38,135 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:38,135 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-07-11 17:55:38,135 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-07-11 17:55:38,136 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:38,136 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:38,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:38,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:55:38,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:55:38,136 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:38,136 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 17:55:38,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:55:38,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:55:38,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:38,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:38,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:55:38,138 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-07-11 17:55:38,138 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5c512939[Count = 0] remaining members to acquire global barrier 2023-07-11 17:55:38,138 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-07-11 17:55:38,138 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:38,139 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:38,139 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:38,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:38,139 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-07-11 17:55:38,139 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-07-11 17:55:38,139 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase9.apache.org,45839,1689097999112' in zk 2023-07-11 17:55:38,139 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:38,139 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 17:55:38,141 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-07-11 17:55:38,141 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:38,141 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:55:38,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:38,141 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-07-11 17:55:38,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:55:38,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:55:38,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:55:38,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:55:38,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:38,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:38,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:55:38,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:38,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:38,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase9.apache.org,45839,1689097999112': 2023-07-11 17:55:38,144 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-07-11 17:55:38,144 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-07-11 17:55:38,144 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 17:55:38,144 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 17:55:38,144 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:38,144 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 17:55:38,145 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:38,145 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:38,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:38,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:55:38,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:55:38,145 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:38,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:38,145 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:55:38,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:55:38,146 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:38,146 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:55:38,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:55:38,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:38,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:38,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:55:38,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:38,147 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:38,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:38,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:55:38,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:38,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:38,149 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:38,149 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:38,149 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:38,149 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:38,149 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:55:38,149 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:55:38,149 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-07-11 17:55:38,150 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:55:38,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:55:38,149 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:38,150 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 17:55:38,149 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:55:38,150 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:38,150 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-07-11 17:55:38,150 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:38,150 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:55:38,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:55:38,150 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-07-11 17:55:38,150 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 17:55:38,250 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 17:55:38,251 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 17:55:38,255 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 17:55:38,257 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-07-11 17:55:38,257 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:38,257 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-07-11 17:55:38,257 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:55:38,257 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-07-11 17:55:38,257 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-07-11 17:55:38,257 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:38,258 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:38,263 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:55:38,263 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:38,263 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:55:38,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:55:38,263 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:38,263 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 17:55:38,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:38,263 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:38,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 17:55:38,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:38,264 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:38,264 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-07-11 17:55:38,264 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:38,264 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-07-11 17:55:38,265 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:55:38,265 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-07-11 17:55:38,265 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 17:55:38,265 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 17:55:38,265 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1689098134208.797d03d17f9b32921e56ea87bcf5ae5e. 2023-07-11 17:55:38,265 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1689098134208.797d03d17f9b32921e56ea87bcf5ae5e. started... 2023-07-11 17:55:38,265 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 797d03d17f9b32921e56ea87bcf5ae5e 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-11 17:55:38,278 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512012f5558dd40fa44f19ce544efc30cb307 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512012f5558dd40fa44f19ce544efc30cb307 2023-07-11 17:55:38,684 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithMonthlyPolicy/797d03d17f9b32921e56ea87bcf5ae5e/.tmp/family1/7470a01642224f629d46a9e5c9864984 2023-07-11 17:55:38,689 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithMonthlyPolicy/797d03d17f9b32921e56ea87bcf5ae5e/.tmp/family1/7470a01642224f629d46a9e5c9864984 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithMonthlyPolicy/797d03d17f9b32921e56ea87bcf5ae5e/family1/7470a01642224f629d46a9e5c9864984 2023-07-11 17:55:38,694 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithMonthlyPolicy/797d03d17f9b32921e56ea87bcf5ae5e/family1/7470a01642224f629d46a9e5c9864984, entries=1, sequenceid=13, filesize=4.9 K 2023-07-11 17:55:38,695 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 797d03d17f9b32921e56ea87bcf5ae5e in 430ms, sequenceid=13, compaction requested=true 2023-07-11 17:55:38,695 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 797d03d17f9b32921e56ea87bcf5ae5e: 2023-07-11 17:55:38,695 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1689098134208.797d03d17f9b32921e56ea87bcf5ae5e. 2023-07-11 17:55:38,695 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 17:55:38,695 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 17:55:38,695 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:38,695 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-07-11 17:55:38,695 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-07-11 17:55:38,697 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:38,697 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:38,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:38,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:55:38,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:55:38,697 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:38,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:55:38,697 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 17:55:38,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:55:38,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:38,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:38,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:55:38,699 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-07-11 17:55:38,699 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@76bbb6c2[Count = 0] remaining members to acquire global barrier 2023-07-11 17:55:38,699 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-07-11 17:55:38,699 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:38,700 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:38,700 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:38,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:38,700 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-07-11 17:55:38,700 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-07-11 17:55:38,700 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:38,700 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase9.apache.org,45839,1689097999112' in zk 2023-07-11 17:55:38,700 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 17:55:38,702 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:38,702 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-07-11 17:55:38,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:38,702 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:55:38,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:55:38,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:55:38,702 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-07-11 17:55:38,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:55:38,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:55:38,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:38,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:38,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:55:38,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:38,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:38,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase9.apache.org,45839,1689097999112': 2023-07-11 17:55:38,705 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-07-11 17:55:38,705 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-07-11 17:55:38,705 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 17:55:38,705 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 17:55:38,705 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:38,705 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 17:55:38,707 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:38,707 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:38,707 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:38,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:38,707 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:55:38,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:38,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:55:38,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:55:38,708 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:55:38,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:55:38,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:55:38,708 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:38,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:38,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:38,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:55:38,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:38,709 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:38,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:38,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:55:38,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:38,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:38,711 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:38,711 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:55:38,711 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:38,711 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-07-11 17:55:38,711 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 17:55:38,711 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:38,711 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:55:38,711 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:55:38,711 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:55:38,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:55:38,711 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:38,711 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:38,711 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-07-11 17:55:38,711 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:38,711 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 17:55:38,712 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:38,712 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:55:38,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:55:38,812 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 17:55:38,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 17:55:38,816 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 17:55:38,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-07-11 17:55:38,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:38,818 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-07-11 17:55:38,818 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:55:38,818 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-07-11 17:55:38,818 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-07-11 17:55:38,818 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:38,819 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:38,820 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:38,820 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:55:38,820 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:55:38,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:55:38,820 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:38,820 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 17:55:38,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:38,820 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:38,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 17:55:38,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:38,821 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:38,821 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-07-11 17:55:38,821 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:38,821 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-07-11 17:55:38,821 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:55:38,821 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-07-11 17:55:38,821 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 17:55:38,821 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 17:55:38,821 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1689098134208.797d03d17f9b32921e56ea87bcf5ae5e. 2023-07-11 17:55:38,821 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1689098134208.797d03d17f9b32921e56ea87bcf5ae5e. started... 2023-07-11 17:55:38,822 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 797d03d17f9b32921e56ea87bcf5ae5e 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-11 17:55:38,833 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120550c43dad44c343c1b0d3afde6a4cc291 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015120550c43dad44c343c1b0d3afde6a4cc291 2023-07-11 17:55:39,238 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithMonthlyPolicy/797d03d17f9b32921e56ea87bcf5ae5e/.tmp/family1/bff57c2c10c04a0697bc1a81340b29a2 2023-07-11 17:55:39,243 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithMonthlyPolicy/797d03d17f9b32921e56ea87bcf5ae5e/.tmp/family1/bff57c2c10c04a0697bc1a81340b29a2 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithMonthlyPolicy/797d03d17f9b32921e56ea87bcf5ae5e/family1/bff57c2c10c04a0697bc1a81340b29a2 2023-07-11 17:55:39,246 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithMonthlyPolicy/797d03d17f9b32921e56ea87bcf5ae5e/family1/bff57c2c10c04a0697bc1a81340b29a2, entries=1, sequenceid=17, filesize=4.9 K 2023-07-11 17:55:39,247 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 797d03d17f9b32921e56ea87bcf5ae5e in 425ms, sequenceid=17, compaction requested=true 2023-07-11 17:55:39,247 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 797d03d17f9b32921e56ea87bcf5ae5e: 2023-07-11 17:55:39,247 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1689098134208.797d03d17f9b32921e56ea87bcf5ae5e. 2023-07-11 17:55:39,247 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 17:55:39,247 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 17:55:39,247 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:39,247 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-07-11 17:55:39,247 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-07-11 17:55:39,249 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:39,249 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:39,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:39,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:55:39,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:55:39,249 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:39,249 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 17:55:39,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:55:39,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:55:39,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:39,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:39,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:55:39,251 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-07-11 17:55:39,251 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6a51cfb7[Count = 0] remaining members to acquire global barrier 2023-07-11 17:55:39,251 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-07-11 17:55:39,251 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:39,253 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:39,253 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:39,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:39,253 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-07-11 17:55:39,253 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-07-11 17:55:39,253 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase9.apache.org,45839,1689097999112' in zk 2023-07-11 17:55:39,253 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:39,253 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 17:55:39,255 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-07-11 17:55:39,255 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:39,255 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:55:39,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:39,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:55:39,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:55:39,255 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-07-11 17:55:39,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:55:39,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:55:39,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:39,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:39,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:55:39,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:39,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:39,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase9.apache.org,45839,1689097999112': 2023-07-11 17:55:39,257 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-07-11 17:55:39,257 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-07-11 17:55:39,257 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 17:55:39,257 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 17:55:39,257 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:39,257 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 17:55:39,259 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:39,259 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:39,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:39,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:55:39,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:55:39,259 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:39,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:39,259 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:55:39,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:55:39,259 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:55:39,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:55:39,259 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:39,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:39,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:39,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:55:39,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:39,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:39,260 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:39,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:55:39,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:39,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:39,263 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:55:39,263 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:55:39,263 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:55:39,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:55:39,263 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:39,263 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-07-11 17:55:39,263 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 17:55:39,263 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:55:39,263 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:39,263 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:55:39,263 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:39,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:55:39,263 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:39,263 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-07-11 17:55:39,264 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 17:55:39,264 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:39,264 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:39,264 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:39,364 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 17:55:39,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 17:55:39,368 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 17:55:39,370 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-07-11 17:55:39,370 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:39,370 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-07-11 17:55:39,370 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:55:39,370 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-07-11 17:55:39,370 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-07-11 17:55:39,371 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:39,371 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:39,374 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:55:39,374 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:39,374 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:55:39,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:55:39,374 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:39,374 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 17:55:39,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:39,375 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:39,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 17:55:39,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:39,375 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:39,375 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-07-11 17:55:39,375 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:39,375 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-07-11 17:55:39,375 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:55:39,375 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-07-11 17:55:39,375 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 17:55:39,375 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 17:55:39,375 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1689098134208.797d03d17f9b32921e56ea87bcf5ae5e. 2023-07-11 17:55:39,375 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1689098134208.797d03d17f9b32921e56ea87bcf5ae5e. started... 2023-07-11 17:55:39,376 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 797d03d17f9b32921e56ea87bcf5ae5e 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-11 17:55:39,385 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228c976172d0fd64b60b4bf57a04361e942 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151228c976172d0fd64b60b4bf57a04361e942 2023-07-11 17:55:39,389 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithMonthlyPolicy/797d03d17f9b32921e56ea87bcf5ae5e/.tmp/family1/8ea3191b09564d5cb738706a5aa22b63 2023-07-11 17:55:39,392 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithMonthlyPolicy/797d03d17f9b32921e56ea87bcf5ae5e/.tmp/family1/8ea3191b09564d5cb738706a5aa22b63 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithMonthlyPolicy/797d03d17f9b32921e56ea87bcf5ae5e/family1/8ea3191b09564d5cb738706a5aa22b63 2023-07-11 17:55:39,396 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithMonthlyPolicy/797d03d17f9b32921e56ea87bcf5ae5e/family1/8ea3191b09564d5cb738706a5aa22b63, entries=1, sequenceid=21, filesize=4.9 K 2023-07-11 17:55:39,396 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 797d03d17f9b32921e56ea87bcf5ae5e in 20ms, sequenceid=21, compaction requested=true 2023-07-11 17:55:39,397 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 797d03d17f9b32921e56ea87bcf5ae5e: 2023-07-11 17:55:39,397 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1689098134208.797d03d17f9b32921e56ea87bcf5ae5e. 2023-07-11 17:55:39,397 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 17:55:39,397 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 17:55:39,397 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:39,397 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-07-11 17:55:39,397 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-07-11 17:55:39,398 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:39,398 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:39,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:39,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:55:39,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:55:39,399 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:39,399 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 17:55:39,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:55:39,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:55:39,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:39,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:39,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:55:39,400 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-07-11 17:55:39,400 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@66fe1a2b[Count = 0] remaining members to acquire global barrier 2023-07-11 17:55:39,400 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-07-11 17:55:39,400 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:39,401 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:39,401 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:39,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:39,402 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-07-11 17:55:39,402 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-07-11 17:55:39,402 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:39,402 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 17:55:39,402 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase9.apache.org,45839,1689097999112' in zk 2023-07-11 17:55:39,403 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:39,403 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-07-11 17:55:39,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:39,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:55:39,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:55:39,403 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:55:39,403 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-07-11 17:55:39,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:55:39,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:55:39,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:39,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:39,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:55:39,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:39,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:39,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase9.apache.org,45839,1689097999112': 2023-07-11 17:55:39,406 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-07-11 17:55:39,406 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-07-11 17:55:39,406 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 17:55:39,406 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 17:55:39,406 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:39,406 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 17:55:39,409 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:39,409 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:39,409 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:39,409 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:55:39,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:39,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:39,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:55:39,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:55:39,410 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:55:39,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:55:39,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:55:39,410 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:39,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:39,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:39,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:55:39,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:39,411 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:39,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:39,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:55:39,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:39,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:39,417 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:39,418 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:55:39,418 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:39,418 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:55:39,418 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:55:39,418 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:55:39,418 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-07-11 17:55:39,418 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-07-11 17:55:39,418 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 17:55:39,418 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:39,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:55:39,418 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:39,418 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:39,418 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:39,418 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:39,418 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-07-11 17:55:39,418 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:55:39,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:55:39,418 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 17:55:39,518 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 17:55:39,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 17:55:39,522 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 17:55:39,524 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-07-11 17:55:39,524 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:39,524 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-07-11 17:55:39,524 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:55:39,524 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-07-11 17:55:39,524 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-07-11 17:55:39,524 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:39,524 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:39,526 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:39,526 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:55:39,526 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:55:39,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:55:39,526 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:39,526 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 17:55:39,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:39,526 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:39,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 17:55:39,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:39,527 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:39,527 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-07-11 17:55:39,527 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:39,527 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-07-11 17:55:39,527 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:55:39,527 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-07-11 17:55:39,527 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 17:55:39,527 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 17:55:39,527 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1689098134208.797d03d17f9b32921e56ea87bcf5ae5e. 2023-07-11 17:55:39,527 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1689098134208.797d03d17f9b32921e56ea87bcf5ae5e. started... 2023-07-11 17:55:39,527 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 797d03d17f9b32921e56ea87bcf5ae5e 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-11 17:55:39,938 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512315fca006fa653403983169b99d11f058b to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512315fca006fa653403983169b99d11f058b 2023-07-11 17:55:40,343 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithMonthlyPolicy/797d03d17f9b32921e56ea87bcf5ae5e/.tmp/family1/f208eb4418474c18b7d940d14fbb4628 2023-07-11 17:55:40,347 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithMonthlyPolicy/797d03d17f9b32921e56ea87bcf5ae5e/.tmp/family1/f208eb4418474c18b7d940d14fbb4628 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithMonthlyPolicy/797d03d17f9b32921e56ea87bcf5ae5e/family1/f208eb4418474c18b7d940d14fbb4628 2023-07-11 17:55:40,350 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithMonthlyPolicy/797d03d17f9b32921e56ea87bcf5ae5e/family1/f208eb4418474c18b7d940d14fbb4628, entries=1, sequenceid=25, filesize=4.9 K 2023-07-11 17:55:40,351 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 797d03d17f9b32921e56ea87bcf5ae5e in 824ms, sequenceid=25, compaction requested=true 2023-07-11 17:55:40,351 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 797d03d17f9b32921e56ea87bcf5ae5e: 2023-07-11 17:55:40,351 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1689098134208.797d03d17f9b32921e56ea87bcf5ae5e. 2023-07-11 17:55:40,351 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 17:55:40,351 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 17:55:40,351 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:40,351 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-07-11 17:55:40,351 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-07-11 17:55:40,353 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:40,353 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:40,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:40,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:55:40,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:55:40,353 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:40,353 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 17:55:40,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:55:40,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:55:40,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:40,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:40,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:55:40,355 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-07-11 17:55:40,355 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3333ef2c[Count = 0] remaining members to acquire global barrier 2023-07-11 17:55:40,355 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-07-11 17:55:40,355 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:40,358 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:40,358 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:40,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:40,358 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-07-11 17:55:40,358 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-07-11 17:55:40,358 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase9.apache.org,45839,1689097999112' in zk 2023-07-11 17:55:40,358 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:40,358 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 17:55:40,359 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-07-11 17:55:40,359 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:40,359 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:55:40,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:40,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:55:40,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:55:40,359 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-07-11 17:55:40,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:55:40,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:55:40,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:40,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:40,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:55:40,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:40,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:40,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase9.apache.org,45839,1689097999112': 2023-07-11 17:55:40,361 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-07-11 17:55:40,361 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-07-11 17:55:40,362 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 17:55:40,362 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 17:55:40,362 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:40,362 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 17:55:40,363 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:40,363 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:40,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:40,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:55:40,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:55:40,363 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:40,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:40,363 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:55:40,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:55:40,364 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:40,364 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:55:40,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:55:40,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:40,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:40,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:55:40,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:40,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:40,365 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:40,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:55:40,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:40,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:40,367 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:40,368 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:40,368 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:55:40,368 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:55:40,368 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:40,368 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:55:40,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:55:40,368 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-07-11 17:55:40,368 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 17:55:40,368 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:55:40,368 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:40,368 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:40,368 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:40,368 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:40,368 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:55:40,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:55:40,368 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-07-11 17:55:40,368 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 17:55:40,468 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 17:55:40,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 17:55:40,473 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 17:55:40,475 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-07-11 17:55:40,475 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:40,475 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-07-11 17:55:40,475 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:55:40,475 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-07-11 17:55:40,475 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-07-11 17:55:40,475 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:40,475 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:40,478 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:55:40,478 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:40,478 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:55:40,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:55:40,478 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:40,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:40,478 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 17:55:40,478 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:40,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 17:55:40,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:40,479 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:40,479 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-07-11 17:55:40,479 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:40,479 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-07-11 17:55:40,479 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:55:40,479 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-07-11 17:55:40,479 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 17:55:40,479 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 17:55:40,479 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1689098134208.797d03d17f9b32921e56ea87bcf5ae5e. 2023-07-11 17:55:40,479 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1689098134208.797d03d17f9b32921e56ea87bcf5ae5e. started... 2023-07-11 17:55:40,479 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 797d03d17f9b32921e56ea87bcf5ae5e 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-11 17:55:40,886 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-07-11 17:55:40,890 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601017cb419b5a2414ab28ac3df235619867e to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601017cb419b5a2414ab28ac3df235619867e 2023-07-11 17:55:40,895 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithMonthlyPolicy/797d03d17f9b32921e56ea87bcf5ae5e/.tmp/family1/a34aef8dd5854546b1eb007d6e345c07 2023-07-11 17:55:40,899 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithMonthlyPolicy/797d03d17f9b32921e56ea87bcf5ae5e/.tmp/family1/a34aef8dd5854546b1eb007d6e345c07 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithMonthlyPolicy/797d03d17f9b32921e56ea87bcf5ae5e/family1/a34aef8dd5854546b1eb007d6e345c07 2023-07-11 17:55:40,902 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithMonthlyPolicy/797d03d17f9b32921e56ea87bcf5ae5e/family1/a34aef8dd5854546b1eb007d6e345c07, entries=1, sequenceid=29, filesize=4.9 K 2023-07-11 17:55:40,903 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 797d03d17f9b32921e56ea87bcf5ae5e in 424ms, sequenceid=29, compaction requested=true 2023-07-11 17:55:40,903 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 797d03d17f9b32921e56ea87bcf5ae5e: 2023-07-11 17:55:40,903 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1689098134208.797d03d17f9b32921e56ea87bcf5ae5e. 2023-07-11 17:55:40,903 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 17:55:40,903 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 17:55:40,903 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:40,903 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-07-11 17:55:40,903 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-07-11 17:55:40,905 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:40,905 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:40,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:40,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:55:40,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:55:40,905 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:40,905 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 17:55:40,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:55:40,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:55:40,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:40,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:40,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:55:40,906 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-07-11 17:55:40,907 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1895522e[Count = 0] remaining members to acquire global barrier 2023-07-11 17:55:40,907 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-07-11 17:55:40,907 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:40,908 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:40,908 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:40,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:40,908 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-07-11 17:55:40,908 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-07-11 17:55:40,908 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase9.apache.org,45839,1689097999112' in zk 2023-07-11 17:55:40,908 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:40,908 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 17:55:40,909 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:40,909 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-07-11 17:55:40,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:40,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:55:40,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:55:40,909 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:55:40,909 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-07-11 17:55:40,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:55:40,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:55:40,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:40,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:40,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:55:40,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:40,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:40,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase9.apache.org,45839,1689097999112': 2023-07-11 17:55:40,912 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-07-11 17:55:40,912 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-07-11 17:55:40,912 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 17:55:40,912 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 17:55:40,912 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:40,912 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 17:55:40,914 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:40,914 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:40,914 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:55:40,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:40,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:55:40,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:55:40,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:55:40,915 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:40,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:40,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:55:40,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:40,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:40,916 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:40,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:55:40,917 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:40,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:40,917 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:55:40,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:40,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:55:40,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:40,919 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:55:40,919 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:40,919 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:55:40,919 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:40,919 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:40,919 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-07-11 17:55:40,919 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 17:55:40,919 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:40,919 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:55:40,919 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:55:40,919 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:40,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:55:40,919 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:40,919 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:40,919 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-07-11 17:55:40,919 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 17:55:40,919 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:55:40,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:55:40,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:40,926 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-07-11 17:55:41,019 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 17:55:41,020 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 17:55:41,024 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 17:55:41,026 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-07-11 17:55:41,026 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:41,026 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-07-11 17:55:41,026 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:55:41,026 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-07-11 17:55:41,026 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-07-11 17:55:41,026 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:41,026 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:41,028 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:41,028 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:55:41,028 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:55:41,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:55:41,028 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:41,028 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 17:55:41,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:41,029 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:41,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 17:55:41,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:41,029 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:41,029 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-07-11 17:55:41,029 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:41,030 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-07-11 17:55:41,030 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:55:41,030 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-07-11 17:55:41,030 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 17:55:41,030 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 17:55:41,030 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1689098134208.797d03d17f9b32921e56ea87bcf5ae5e. 2023-07-11 17:55:41,030 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1689098134208.797d03d17f9b32921e56ea87bcf5ae5e. started... 2023-07-11 17:55:41,030 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 797d03d17f9b32921e56ea87bcf5ae5e 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-11 17:55:41,043 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103b869951f358f47cf87d0f0b5953ffb8f to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160103b869951f358f47cf87d0f0b5953ffb8f 2023-07-11 17:55:41,050 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithMonthlyPolicy/797d03d17f9b32921e56ea87bcf5ae5e/.tmp/family1/bda36c37e85d4451bd5a4307556048eb 2023-07-11 17:55:41,054 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithMonthlyPolicy/797d03d17f9b32921e56ea87bcf5ae5e/.tmp/family1/bda36c37e85d4451bd5a4307556048eb as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithMonthlyPolicy/797d03d17f9b32921e56ea87bcf5ae5e/family1/bda36c37e85d4451bd5a4307556048eb 2023-07-11 17:55:41,057 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithMonthlyPolicy/797d03d17f9b32921e56ea87bcf5ae5e/family1/bda36c37e85d4451bd5a4307556048eb, entries=1, sequenceid=33, filesize=4.9 K 2023-07-11 17:55:41,058 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 797d03d17f9b32921e56ea87bcf5ae5e in 28ms, sequenceid=33, compaction requested=true 2023-07-11 17:55:41,058 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 797d03d17f9b32921e56ea87bcf5ae5e: 2023-07-11 17:55:41,058 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1689098134208.797d03d17f9b32921e56ea87bcf5ae5e. 2023-07-11 17:55:41,058 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 17:55:41,058 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 17:55:41,058 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:41,058 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-07-11 17:55:41,058 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-07-11 17:55:41,060 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:41,060 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:41,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:41,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:55:41,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:55:41,060 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:41,060 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 17:55:41,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:55:41,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:55:41,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:41,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:41,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:55:41,061 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-07-11 17:55:41,061 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7cdd0afc[Count = 0] remaining members to acquire global barrier 2023-07-11 17:55:41,062 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-07-11 17:55:41,062 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:41,064 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:41,064 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:41,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:41,064 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-07-11 17:55:41,064 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-07-11 17:55:41,064 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase9.apache.org,45839,1689097999112' in zk 2023-07-11 17:55:41,064 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:41,064 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 17:55:41,065 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:41,065 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-07-11 17:55:41,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:41,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:55:41,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:55:41,065 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:55:41,065 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-07-11 17:55:41,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:55:41,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:55:41,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:41,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:41,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:55:41,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:41,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:41,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase9.apache.org,45839,1689097999112': 2023-07-11 17:55:41,068 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-07-11 17:55:41,068 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-07-11 17:55:41,068 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 17:55:41,068 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 17:55:41,068 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:41,068 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 17:55:41,072 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:41,072 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:41,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:41,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:55:41,072 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:41,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:41,072 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:55:41,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:55:41,072 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:55:41,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:55:41,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:55:41,072 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:41,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:41,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:41,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:55:41,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:41,073 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:41,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:41,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:55:41,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:41,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:41,076 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:55:41,076 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:55:41,076 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:55:41,076 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:41,076 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-07-11 17:55:41,076 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 17:55:41,076 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:55:41,076 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:41,076 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:41,076 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:41,076 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:41,076 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:41,076 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:41,076 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-07-11 17:55:41,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:55:41,076 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-07-11 17:55:41,076 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 17:55:41,077 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:55:41,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:55:41,177 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 17:55:41,177 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 17:55:41,181 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 17:55:41,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-07-11 17:55:41,183 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:41,183 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-07-11 17:55:41,183 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:55:41,183 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-07-11 17:55:41,183 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-07-11 17:55:41,183 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:41,183 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:41,184 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:41,184 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:55:41,184 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:55:41,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:55:41,184 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:41,184 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 17:55:41,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:41,185 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:41,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 17:55:41,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:41,185 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:41,185 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-07-11 17:55:41,186 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:41,186 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-07-11 17:55:41,186 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:55:41,186 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-07-11 17:55:41,186 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 17:55:41,186 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 17:55:41,186 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1689098134208.797d03d17f9b32921e56ea87bcf5ae5e. 2023-07-11 17:55:41,186 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1689098134208.797d03d17f9b32921e56ea87bcf5ae5e. started... 2023-07-11 17:55:41,186 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 797d03d17f9b32921e56ea87bcf5ae5e 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-11 17:55:41,600 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015090712519e09badb45f29515aa0b75560e39 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015090712519e09badb45f29515aa0b75560e39 2023-07-11 17:55:41,607 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithMonthlyPolicy/797d03d17f9b32921e56ea87bcf5ae5e/.tmp/family1/cf6d6bbf5f914d2b85c881a6f9faf47d 2023-07-11 17:55:41,611 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithMonthlyPolicy/797d03d17f9b32921e56ea87bcf5ae5e/.tmp/family1/cf6d6bbf5f914d2b85c881a6f9faf47d as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithMonthlyPolicy/797d03d17f9b32921e56ea87bcf5ae5e/family1/cf6d6bbf5f914d2b85c881a6f9faf47d 2023-07-11 17:55:41,614 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithMonthlyPolicy/797d03d17f9b32921e56ea87bcf5ae5e/family1/cf6d6bbf5f914d2b85c881a6f9faf47d, entries=1, sequenceid=37, filesize=4.9 K 2023-07-11 17:55:41,615 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 797d03d17f9b32921e56ea87bcf5ae5e in 429ms, sequenceid=37, compaction requested=true 2023-07-11 17:55:41,615 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 797d03d17f9b32921e56ea87bcf5ae5e: 2023-07-11 17:55:41,615 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1689098134208.797d03d17f9b32921e56ea87bcf5ae5e. 2023-07-11 17:55:41,615 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 17:55:41,615 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 17:55:41,615 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:41,615 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-07-11 17:55:41,615 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-07-11 17:55:41,618 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:41,618 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:41,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:41,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:55:41,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:55:41,618 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:41,618 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 17:55:41,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:55:41,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:55:41,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:41,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:41,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:55:41,620 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-07-11 17:55:41,620 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6a64680e[Count = 0] remaining members to acquire global barrier 2023-07-11 17:55:41,620 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-07-11 17:55:41,620 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:41,621 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:41,621 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:41,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:41,621 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-07-11 17:55:41,621 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-07-11 17:55:41,621 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase9.apache.org,45839,1689097999112' in zk 2023-07-11 17:55:41,621 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:41,621 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 17:55:41,622 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-07-11 17:55:41,622 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:41,622 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:55:41,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:41,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:55:41,622 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-07-11 17:55:41,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:55:41,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:55:41,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:55:41,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:41,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:41,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:55:41,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:41,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:41,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase9.apache.org,45839,1689097999112': 2023-07-11 17:55:41,625 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-07-11 17:55:41,625 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-07-11 17:55:41,625 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 17:55:41,625 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 17:55:41,625 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:41,626 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 17:55:41,627 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:41,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:41,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:55:41,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:55:41,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:55:41,628 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:41,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:41,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:55:41,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:41,629 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:41,629 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:41,629 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:55:41,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:41,629 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:41,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:41,630 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:55:41,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:55:41,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:55:41,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:41,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:41,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:41,633 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:41,633 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:41,633 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:41,634 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:41,634 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-07-11 17:55:41,634 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 17:55:41,634 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:41,634 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:55:41,634 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:41,634 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:55:41,634 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-07-11 17:55:41,634 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:41,634 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-07-11 17:55:41,634 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:55:41,634 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:55:41,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:55:41,634 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 17:55:41,634 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:55:41,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:55:41,734 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 17:55:41,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 17:55:41,739 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 17:55:41,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-07-11 17:55:41,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:41,740 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-07-11 17:55:41,740 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:55:41,740 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-07-11 17:55:41,740 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-07-11 17:55:41,741 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:41,741 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:41,742 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:41,742 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:55:41,742 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:55:41,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:55:41,742 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:41,742 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 17:55:41,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:41,743 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:41,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 17:55:41,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:41,743 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:41,743 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-07-11 17:55:41,743 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:41,743 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-07-11 17:55:41,743 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:55:41,743 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-07-11 17:55:41,744 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 17:55:41,744 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 17:55:41,744 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1689098134208.797d03d17f9b32921e56ea87bcf5ae5e. 2023-07-11 17:55:41,744 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1689098134208.797d03d17f9b32921e56ea87bcf5ae5e. started... 2023-07-11 17:55:41,744 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 797d03d17f9b32921e56ea87bcf5ae5e 1/1 column families, dataSize=73 B heapSize=408 B 2023-07-11 17:55:42,156 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511201b2d2d474cb144c089f29f748ade414d to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511201b2d2d474cb144c089f29f748ade414d 2023-07-11 17:55:42,562 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithMonthlyPolicy/797d03d17f9b32921e56ea87bcf5ae5e/.tmp/family1/e3e25d9f49f3429d947e186b5fb9d15b 2023-07-11 17:55:42,567 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithMonthlyPolicy/797d03d17f9b32921e56ea87bcf5ae5e/.tmp/family1/e3e25d9f49f3429d947e186b5fb9d15b as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithMonthlyPolicy/797d03d17f9b32921e56ea87bcf5ae5e/family1/e3e25d9f49f3429d947e186b5fb9d15b 2023-07-11 17:55:42,571 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithMonthlyPolicy/797d03d17f9b32921e56ea87bcf5ae5e/family1/e3e25d9f49f3429d947e186b5fb9d15b, entries=1, sequenceid=41, filesize=4.9 K 2023-07-11 17:55:42,572 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 797d03d17f9b32921e56ea87bcf5ae5e in 828ms, sequenceid=41, compaction requested=true 2023-07-11 17:55:42,572 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 797d03d17f9b32921e56ea87bcf5ae5e: 2023-07-11 17:55:42,572 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1689098134208.797d03d17f9b32921e56ea87bcf5ae5e. 2023-07-11 17:55:42,572 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 17:55:42,572 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 17:55:42,572 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:42,572 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-07-11 17:55:42,572 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-07-11 17:55:42,574 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:42,574 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:42,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:42,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:55:42,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:55:42,575 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:42,575 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 17:55:42,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:55:42,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:55:42,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:42,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:42,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:55:42,576 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-07-11 17:55:42,576 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4602b0e1[Count = 0] remaining members to acquire global barrier 2023-07-11 17:55:42,576 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-07-11 17:55:42,577 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:42,578 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:42,578 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:42,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:42,578 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-07-11 17:55:42,578 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-07-11 17:55:42,578 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:42,578 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 17:55:42,578 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase9.apache.org,45839,1689097999112' in zk 2023-07-11 17:55:42,581 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-07-11 17:55:42,581 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:42,581 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:55:42,581 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-07-11 17:55:42,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:42,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:55:42,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:55:42,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:55:42,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:55:42,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:42,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:42,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:55:42,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:42,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:42,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase9.apache.org,45839,1689097999112': 2023-07-11 17:55:42,584 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-07-11 17:55:42,584 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-07-11 17:55:42,584 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 17:55:42,584 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 17:55:42,585 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:42,585 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 17:55:42,586 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:42,586 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:42,586 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:42,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:42,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:55:42,586 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:55:42,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:55:42,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:42,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:55:42,587 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:55:42,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:55:42,587 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:42,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:42,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:42,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:55:42,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:42,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:42,589 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:42,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:55:42,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:42,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:42,592 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:42,592 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:55:42,592 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:42,592 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:55:42,592 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:42,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:55:42,592 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:55:42,592 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:55:42,592 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-07-11 17:55:42,592 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 17:55:42,592 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:42,592 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:42,592 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:42,592 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:42,592 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:55:42,592 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-07-11 17:55:42,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:55:42,592 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 17:55:42,693 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 17:55:42,693 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 17:55:42,694 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=36885] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMinorCompactionWithMonthlyPolicy 2023-07-11 17:55:42,696 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] procedure2.ProcedureExecutor(1029): Stored pid=115, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-07-11 17:55:42,697 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=115, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-07-11 17:55:42,697 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] mob.MobUtils(833): start MOB compaction of files for table='testMinorCompactionWithMonthlyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-07-11 17:55:42,697 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=115, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1689098742697 2023-07-11 17:55:42,698 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-07-11 17:55:42,699 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMinorCompactionWithMonthlyPolicy' and column 'family1' 2023-07-11 17:55:42,699 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-07-11 17:55:42,699 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] zookeeper.ReadOnlyZKClient(139): Connect 0x7a2ea0de to 127.0.0.1:50702 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 17:55:42,703 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@10f6172e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 17:55:42,703 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-07-11 17:55:43,128 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601037e77ae52361343a1b5e1d646c28f21f4 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601037e77ae52361343a1b5e1d646c28f21f4 2023-07-11 17:55:43,129 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-07-11 17:55:43,142 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 17:55:43,144 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:33400, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 17:55:43,150 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-11 17:55:43,151 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:33608, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-11 17:55:43,159 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/3496504cf25c4e759229cb5564c0e865 first=Optional[r5] last=Optional[r6] 2023-07-11 17:55:43,160 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1689098134208.797d03d17f9b32921e56ea87bcf5ae5e., hostname=jenkins-hbase9.apache.org,45839,1689097999112, seqNum=2 for row with hfile group [{family1,hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/3496504cf25c4e759229cb5564c0e865}] 2023-07-11 17:55:43,165 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(763): Validating hfile at hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/3496504cf25c4e759229cb5564c0e865 for inclusion in 797d03d17f9b32921e56ea87bcf5ae5e/family1 2023-07-11 17:55:43,167 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(775): HFile bounds: first=r5 last=r6 2023-07-11 17:55:43,167 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(777): Region bounds: first= last= 2023-07-11 17:55:43,167 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HRegion(2446): Flush status journal for 797d03d17f9b32921e56ea87bcf5ae5e: 2023-07-11 17:55:43,168 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/3496504cf25c4e759229cb5564c0e865 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testMinorCompactionWithMonthlyPolicy__iegbr5au3mmb8pjvhro67dqk6e4l9pvlofl376neerjgrtartim40c2fh9aea7of/family1/3496504cf25c4e759229cb5564c0e865 2023-07-11 17:55:43,170 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testMinorCompactionWithMonthlyPolicy__iegbr5au3mmb8pjvhro67dqk6e4l9pvlofl376neerjgrtartim40c2fh9aea7of/family1/3496504cf25c4e759229cb5564c0e865 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithMonthlyPolicy/797d03d17f9b32921e56ea87bcf5ae5e/family1/478390f0daab4e92992f6975af284a4e_SeqId_44_ 2023-07-11 17:55:43,171 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(849): Loaded HFile hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testMinorCompactionWithMonthlyPolicy__iegbr5au3mmb8pjvhro67dqk6e4l9pvlofl376neerjgrtartim40c2fh9aea7of/family1/3496504cf25c4e759229cb5564c0e865 into 797d03d17f9b32921e56ea87bcf5ae5e/family1 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithMonthlyPolicy/797d03d17f9b32921e56ea87bcf5ae5e/family1/478390f0daab4e92992f6975af284a4e_SeqId_44_ - updating store file list. 2023-07-11 17:55:43,174 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(882): Loaded HFile hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithMonthlyPolicy/797d03d17f9b32921e56ea87bcf5ae5e/family1/478390f0daab4e92992f6975af284a4e_SeqId_44_ into 797d03d17f9b32921e56ea87bcf5ae5e/family1 2023-07-11 17:55:43,174 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(855): Successfully loaded hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testMinorCompactionWithMonthlyPolicy__iegbr5au3mmb8pjvhro67dqk6e4l9pvlofl376neerjgrtartim40c2fh9aea7of/family1/3496504cf25c4e759229cb5564c0e865 into 797d03d17f9b32921e56ea87bcf5ae5e/family1 (new location: hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithMonthlyPolicy/797d03d17f9b32921e56ea87bcf5ae5e/family1/478390f0daab4e92992f6975af284a4e_SeqId_44_) 2023-07-11 17:55:43,174 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testMinorCompactionWithMonthlyPolicy__iegbr5au3mmb8pjvhro67dqk6e4l9pvlofl376neerjgrtartim40c2fh9aea7of/family1/3496504cf25c4e759229cb5564c0e865 2023-07-11 17:55:43,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-07-11 17:55:43,177 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 50903 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-07-11 17:55:43,177 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(1912): 797d03d17f9b32921e56ea87bcf5ae5e/family1 is initiating minor compaction 2023-07-11 17:55:43,177 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@379256f8; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-11 17:55:43,177 INFO [RS:0;jenkins-hbase9:45839-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 797d03d17f9b32921e56ea87bcf5ae5e/family1 in testMinorCompactionWithMonthlyPolicy,,1689098134208.797d03d17f9b32921e56ea87bcf5ae5e. 2023-07-11 17:55:43,177 INFO [RS:0;jenkins-hbase9:45839-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithMonthlyPolicy/797d03d17f9b32921e56ea87bcf5ae5e/family1/e4917da2ac564678ae1cfcd0f6fa34e1, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithMonthlyPolicy/797d03d17f9b32921e56ea87bcf5ae5e/family1/7470a01642224f629d46a9e5c9864984, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithMonthlyPolicy/797d03d17f9b32921e56ea87bcf5ae5e/family1/bff57c2c10c04a0697bc1a81340b29a2, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithMonthlyPolicy/797d03d17f9b32921e56ea87bcf5ae5e/family1/8ea3191b09564d5cb738706a5aa22b63, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithMonthlyPolicy/797d03d17f9b32921e56ea87bcf5ae5e/family1/f208eb4418474c18b7d940d14fbb4628, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithMonthlyPolicy/797d03d17f9b32921e56ea87bcf5ae5e/family1/a34aef8dd5854546b1eb007d6e345c07, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithMonthlyPolicy/797d03d17f9b32921e56ea87bcf5ae5e/family1/bda36c37e85d4451bd5a4307556048eb, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithMonthlyPolicy/797d03d17f9b32921e56ea87bcf5ae5e/family1/cf6d6bbf5f914d2b85c881a6f9faf47d, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithMonthlyPolicy/797d03d17f9b32921e56ea87bcf5ae5e/family1/e3e25d9f49f3429d947e186b5fb9d15b, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithMonthlyPolicy/797d03d17f9b32921e56ea87bcf5ae5e/family1/478390f0daab4e92992f6975af284a4e_SeqId_44_] into tmpdir=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithMonthlyPolicy/797d03d17f9b32921e56ea87bcf5ae5e/.tmp, totalSize=49.7 K 2023-07-11 17:55:43,177 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] compactions.Compactor(207): Compacting e4917da2ac564678ae1cfcd0f6fa34e1, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-07-11 17:55:43,177 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] compactions.Compactor(207): Compacting 7470a01642224f629d46a9e5c9864984, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-07-11 17:55:43,178 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] compactions.Compactor(207): Compacting bff57c2c10c04a0697bc1a81340b29a2, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-07-11 17:55:43,178 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] compactions.Compactor(207): Compacting 8ea3191b09564d5cb738706a5aa22b63, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-07-11 17:55:43,178 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] compactions.Compactor(207): Compacting f208eb4418474c18b7d940d14fbb4628, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-07-11 17:55:43,178 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] compactions.Compactor(207): Compacting a34aef8dd5854546b1eb007d6e345c07, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-07-11 17:55:43,178 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] compactions.Compactor(207): Compacting bda36c37e85d4451bd5a4307556048eb, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-07-11 17:55:43,178 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] compactions.Compactor(207): Compacting cf6d6bbf5f914d2b85c881a6f9faf47d, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-07-11 17:55:43,178 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] compactions.Compactor(207): Compacting e3e25d9f49f3429d947e186b5fb9d15b, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-07-11 17:55:43,178 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] compactions.Compactor(207): Compacting 478390f0daab4e92992f6975af284a4e_SeqId_44_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=45 2023-07-11 17:55:43,179 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-07-11 17:55:43,179 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 17:55:43,181 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601017cb419b5a2414ab28ac3df235619867e to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601017cb419b5a2414ab28ac3df235619867e 2023-07-11 17:55:43,182 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160103b869951f358f47cf87d0f0b5953ffb8f to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160103b869951f358f47cf87d0f0b5953ffb8f 2023-07-11 17:55:43,182 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 2 expired mob files are deleted 2023-07-11 17:55:43,182 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101' 2023-07-11 17:55:43,183 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-07-11 17:55:43,183 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-07-11 17:55:43,211 INFO [RS:0;jenkins-hbase9:45839-shortCompactions-0] throttle.PressureAwareThroughputController(145): 797d03d17f9b32921e56ea87bcf5ae5e#family1#compaction#165 average throughput is 0.34 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-11 17:55:43,225 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithMonthlyPolicy/797d03d17f9b32921e56ea87bcf5ae5e/.tmp/family1/adc6843f560e4f4bbfdbe5f992512d64 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithMonthlyPolicy/797d03d17f9b32921e56ea87bcf5ae5e/family1/adc6843f560e4f4bbfdbe5f992512d64 2023-07-11 17:55:43,227 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231047228313e2b418386dce1e6cf176cfc to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151231047228313e2b418386dce1e6cf176cfc 2023-07-11 17:55:43,228 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-07-11 17:55:43,229 INFO [RS:0;jenkins-hbase9:45839-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 797d03d17f9b32921e56ea87bcf5ae5e/family1 of 797d03d17f9b32921e56ea87bcf5ae5e into adc6843f560e4f4bbfdbe5f992512d64(size=6.6 K), total size for store is 172.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-11 17:55:43,229 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 797d03d17f9b32921e56ea87bcf5ae5e: 2023-07-11 17:55:43,229 INFO [RS:0;jenkins-hbase9:45839-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithMonthlyPolicy,,1689098134208.797d03d17f9b32921e56ea87bcf5ae5e., storeName=family1, fileCount=10, fileSize=49.7 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.2 K), priority=2, time=1689098143177; duration=0sec 2023-07-11 17:55:43,229 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-11 17:55:43,237 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithMonthlyPolicy/797d03d17f9b32921e56ea87bcf5ae5e/family1/e4917da2ac564678ae1cfcd0f6fa34e1, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithMonthlyPolicy/797d03d17f9b32921e56ea87bcf5ae5e/family1/7470a01642224f629d46a9e5c9864984, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithMonthlyPolicy/797d03d17f9b32921e56ea87bcf5ae5e/family1/bff57c2c10c04a0697bc1a81340b29a2, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithMonthlyPolicy/797d03d17f9b32921e56ea87bcf5ae5e/family1/8ea3191b09564d5cb738706a5aa22b63, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithMonthlyPolicy/797d03d17f9b32921e56ea87bcf5ae5e/family1/f208eb4418474c18b7d940d14fbb4628, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithMonthlyPolicy/797d03d17f9b32921e56ea87bcf5ae5e/family1/a34aef8dd5854546b1eb007d6e345c07, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithMonthlyPolicy/797d03d17f9b32921e56ea87bcf5ae5e/family1/bda36c37e85d4451bd5a4307556048eb, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithMonthlyPolicy/797d03d17f9b32921e56ea87bcf5ae5e/family1/cf6d6bbf5f914d2b85c881a6f9faf47d, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithMonthlyPolicy/797d03d17f9b32921e56ea87bcf5ae5e/family1/e3e25d9f49f3429d947e186b5fb9d15b, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithMonthlyPolicy/797d03d17f9b32921e56ea87bcf5ae5e/family1/478390f0daab4e92992f6975af284a4e_SeqId_44_] to archive 2023-07-11 17:55:43,238 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 17:55:43,239 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithMonthlyPolicy/797d03d17f9b32921e56ea87bcf5ae5e/family1/e4917da2ac564678ae1cfcd0f6fa34e1 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMinorCompactionWithMonthlyPolicy/797d03d17f9b32921e56ea87bcf5ae5e/family1/e4917da2ac564678ae1cfcd0f6fa34e1 2023-07-11 17:55:43,240 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithMonthlyPolicy/797d03d17f9b32921e56ea87bcf5ae5e/family1/7470a01642224f629d46a9e5c9864984 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMinorCompactionWithMonthlyPolicy/797d03d17f9b32921e56ea87bcf5ae5e/family1/7470a01642224f629d46a9e5c9864984 2023-07-11 17:55:43,241 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithMonthlyPolicy/797d03d17f9b32921e56ea87bcf5ae5e/family1/bff57c2c10c04a0697bc1a81340b29a2 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMinorCompactionWithMonthlyPolicy/797d03d17f9b32921e56ea87bcf5ae5e/family1/bff57c2c10c04a0697bc1a81340b29a2 2023-07-11 17:55:43,242 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithMonthlyPolicy/797d03d17f9b32921e56ea87bcf5ae5e/family1/8ea3191b09564d5cb738706a5aa22b63 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMinorCompactionWithMonthlyPolicy/797d03d17f9b32921e56ea87bcf5ae5e/family1/8ea3191b09564d5cb738706a5aa22b63 2023-07-11 17:55:43,243 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithMonthlyPolicy/797d03d17f9b32921e56ea87bcf5ae5e/family1/f208eb4418474c18b7d940d14fbb4628 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMinorCompactionWithMonthlyPolicy/797d03d17f9b32921e56ea87bcf5ae5e/family1/f208eb4418474c18b7d940d14fbb4628 2023-07-11 17:55:43,245 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithMonthlyPolicy/797d03d17f9b32921e56ea87bcf5ae5e/family1/a34aef8dd5854546b1eb007d6e345c07 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMinorCompactionWithMonthlyPolicy/797d03d17f9b32921e56ea87bcf5ae5e/family1/a34aef8dd5854546b1eb007d6e345c07 2023-07-11 17:55:43,246 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithMonthlyPolicy/797d03d17f9b32921e56ea87bcf5ae5e/family1/bda36c37e85d4451bd5a4307556048eb to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMinorCompactionWithMonthlyPolicy/797d03d17f9b32921e56ea87bcf5ae5e/family1/bda36c37e85d4451bd5a4307556048eb 2023-07-11 17:55:43,248 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithMonthlyPolicy/797d03d17f9b32921e56ea87bcf5ae5e/family1/cf6d6bbf5f914d2b85c881a6f9faf47d to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMinorCompactionWithMonthlyPolicy/797d03d17f9b32921e56ea87bcf5ae5e/family1/cf6d6bbf5f914d2b85c881a6f9faf47d 2023-07-11 17:55:43,249 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithMonthlyPolicy/797d03d17f9b32921e56ea87bcf5ae5e/family1/e3e25d9f49f3429d947e186b5fb9d15b to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMinorCompactionWithMonthlyPolicy/797d03d17f9b32921e56ea87bcf5ae5e/family1/e3e25d9f49f3429d947e186b5fb9d15b 2023-07-11 17:55:43,251 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithMonthlyPolicy/797d03d17f9b32921e56ea87bcf5ae5e/family1/478390f0daab4e92992f6975af284a4e_SeqId_44_ to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMinorCompactionWithMonthlyPolicy/797d03d17f9b32921e56ea87bcf5ae5e/family1/478390f0daab4e92992f6975af284a4e_SeqId_44_ 2023-07-11 17:55:43,258 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/29efa075877942d6beb58c120877adf8 first=Optional[r1] last=Optional[r4] 2023-07-11 17:55:43,258 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1689098134208.797d03d17f9b32921e56ea87bcf5ae5e., hostname=jenkins-hbase9.apache.org,45839,1689097999112, seqNum=2 for row with hfile group [{family1,hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/29efa075877942d6beb58c120877adf8}] 2023-07-11 17:55:43,260 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(763): Validating hfile at hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/29efa075877942d6beb58c120877adf8 for inclusion in 797d03d17f9b32921e56ea87bcf5ae5e/family1 2023-07-11 17:55:43,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(775): HFile bounds: first=r1 last=r4 2023-07-11 17:55:43,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(777): Region bounds: first= last= 2023-07-11 17:55:43,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HRegion(2446): Flush status journal for 797d03d17f9b32921e56ea87bcf5ae5e: 2023-07-11 17:55:43,264 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/29efa075877942d6beb58c120877adf8 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testMinorCompactionWithMonthlyPolicy__govf8ab2tr46tfuki57eo1eh28aa0i70l2bakk95rs6udo7vlq6bem5k72okee8s/family1/29efa075877942d6beb58c120877adf8 2023-07-11 17:55:43,266 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testMinorCompactionWithMonthlyPolicy__govf8ab2tr46tfuki57eo1eh28aa0i70l2bakk95rs6udo7vlq6bem5k72okee8s/family1/29efa075877942d6beb58c120877adf8 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithMonthlyPolicy/797d03d17f9b32921e56ea87bcf5ae5e/family1/77025267dd4a442baf34d051ce6920f6_SeqId_47_ 2023-07-11 17:55:43,266 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(849): Loaded HFile hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testMinorCompactionWithMonthlyPolicy__govf8ab2tr46tfuki57eo1eh28aa0i70l2bakk95rs6udo7vlq6bem5k72okee8s/family1/29efa075877942d6beb58c120877adf8 into 797d03d17f9b32921e56ea87bcf5ae5e/family1 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithMonthlyPolicy/797d03d17f9b32921e56ea87bcf5ae5e/family1/77025267dd4a442baf34d051ce6920f6_SeqId_47_ - updating store file list. 2023-07-11 17:55:43,274 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(882): Loaded HFile hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithMonthlyPolicy/797d03d17f9b32921e56ea87bcf5ae5e/family1/77025267dd4a442baf34d051ce6920f6_SeqId_47_ into 797d03d17f9b32921e56ea87bcf5ae5e/family1 2023-07-11 17:55:43,274 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(855): Successfully loaded hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testMinorCompactionWithMonthlyPolicy__govf8ab2tr46tfuki57eo1eh28aa0i70l2bakk95rs6udo7vlq6bem5k72okee8s/family1/29efa075877942d6beb58c120877adf8 into 797d03d17f9b32921e56ea87bcf5ae5e/family1 (new location: hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithMonthlyPolicy/797d03d17f9b32921e56ea87bcf5ae5e/family1/77025267dd4a442baf34d051ce6920f6_SeqId_47_) 2023-07-11 17:55:43,275 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testMinorCompactionWithMonthlyPolicy__govf8ab2tr46tfuki57eo1eh28aa0i70l2bakk95rs6udo7vlq6bem5k72okee8s/family1/29efa075877942d6beb58c120877adf8 2023-07-11 17:55:43,275 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-07-11 17:55:43,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 182349 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-07-11 17:55:43,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(1912): 797d03d17f9b32921e56ea87bcf5ae5e/family1 is initiating minor compaction (all files) 2023-07-11 17:55:43,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@7bbaf9ae; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-11 17:55:43,276 INFO [RS:0;jenkins-hbase9:45839-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 797d03d17f9b32921e56ea87bcf5ae5e/family1 in testMinorCompactionWithMonthlyPolicy,,1689098134208.797d03d17f9b32921e56ea87bcf5ae5e. 2023-07-11 17:55:43,276 INFO [RS:0;jenkins-hbase9:45839-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithMonthlyPolicy/797d03d17f9b32921e56ea87bcf5ae5e/family1/b74660833a834ba78475d944b74cc753, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithMonthlyPolicy/797d03d17f9b32921e56ea87bcf5ae5e/family1/adc6843f560e4f4bbfdbe5f992512d64, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithMonthlyPolicy/797d03d17f9b32921e56ea87bcf5ae5e/family1/77025267dd4a442baf34d051ce6920f6_SeqId_47_] into tmpdir=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithMonthlyPolicy/797d03d17f9b32921e56ea87bcf5ae5e/.tmp, totalSize=178.1 K 2023-07-11 17:55:43,277 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] compactions.Compactor(207): Compacting b74660833a834ba78475d944b74cc753, keycount=1000, bloomtype=ROW, size=166.0 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878822106 2023-07-11 17:55:43,277 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] compactions.Compactor(207): Compacting adc6843f560e4f4bbfdbe5f992512d64, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621222106 2023-07-11 17:55:43,277 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] compactions.Compactor(207): Compacting 77025267dd4a442baf34d051ce6920f6_SeqId_47_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965222106 2023-07-11 17:55:43,278 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-07-11 17:55:43,279 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 17:55:43,280 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512012f5558dd40fa44f19ce544efc30cb307 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512012f5558dd40fa44f19ce544efc30cb307 2023-07-11 17:55:43,282 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015120550c43dad44c343c1b0d3afde6a4cc291 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015120550c43dad44c343c1b0d3afde6a4cc291 2023-07-11 17:55:43,283 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151228c976172d0fd64b60b4bf57a04361e942 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151228c976172d0fd64b60b4bf57a04361e942 2023-07-11 17:55:43,284 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512315fca006fa653403983169b99d11f058b to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512315fca006fa653403983169b99d11f058b 2023-07-11 17:55:43,284 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 4 expired mob files are deleted 2023-07-11 17:55:43,284 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201' 2023-07-11 17:55:43,285 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-07-11 17:55:43,285 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-07-11 17:55:43,299 INFO [RS:0;jenkins-hbase9:45839-shortCompactions-0] throttle.PressureAwareThroughputController(145): 797d03d17f9b32921e56ea87bcf5ae5e#family1#compaction#166 average throughput is 11.11 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-11 17:55:43,330 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithMonthlyPolicy/797d03d17f9b32921e56ea87bcf5ae5e/.tmp/family1/7489aff47cca45e589a3c98461bdd1b4 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithMonthlyPolicy/797d03d17f9b32921e56ea87bcf5ae5e/family1/7489aff47cca45e589a3c98461bdd1b4 2023-07-11 17:55:43,334 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015113084515471ae3747a1a7fb3649d1cb921c to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015113084515471ae3747a1a7fb3649d1cb921c 2023-07-11 17:55:43,335 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-07-11 17:55:43,335 INFO [RS:0;jenkins-hbase9:45839-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 797d03d17f9b32921e56ea87bcf5ae5e/family1 of 797d03d17f9b32921e56ea87bcf5ae5e into 7489aff47cca45e589a3c98461bdd1b4(size=167.4 K), total size for store is 167.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-11 17:55:43,335 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 797d03d17f9b32921e56ea87bcf5ae5e: 2023-07-11 17:55:43,335 INFO [RS:0;jenkins-hbase9:45839-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithMonthlyPolicy,,1689098134208.797d03d17f9b32921e56ea87bcf5ae5e., storeName=family1, fileCount=3, fileSize=178.1 K (166.0 K, 6.6 K, 5.5 K), priority=2, time=1689098143276; duration=0sec 2023-07-11 17:55:43,335 DEBUG [RS:0;jenkins-hbase9:45839-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-11 17:55:43,336 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithMonthlyPolicy/797d03d17f9b32921e56ea87bcf5ae5e/family1/b74660833a834ba78475d944b74cc753, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithMonthlyPolicy/797d03d17f9b32921e56ea87bcf5ae5e/family1/adc6843f560e4f4bbfdbe5f992512d64, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithMonthlyPolicy/797d03d17f9b32921e56ea87bcf5ae5e/family1/77025267dd4a442baf34d051ce6920f6_SeqId_47_] to archive 2023-07-11 17:55:43,337 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 17:55:43,339 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithMonthlyPolicy/797d03d17f9b32921e56ea87bcf5ae5e/family1/b74660833a834ba78475d944b74cc753 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMinorCompactionWithMonthlyPolicy/797d03d17f9b32921e56ea87bcf5ae5e/family1/b74660833a834ba78475d944b74cc753 2023-07-11 17:55:43,340 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithMonthlyPolicy/797d03d17f9b32921e56ea87bcf5ae5e/family1/adc6843f560e4f4bbfdbe5f992512d64 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMinorCompactionWithMonthlyPolicy/797d03d17f9b32921e56ea87bcf5ae5e/family1/adc6843f560e4f4bbfdbe5f992512d64 2023-07-11 17:55:43,342 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithMonthlyPolicy/797d03d17f9b32921e56ea87bcf5ae5e/family1/77025267dd4a442baf34d051ce6920f6_SeqId_47_ to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMinorCompactionWithMonthlyPolicy/797d03d17f9b32921e56ea87bcf5ae5e/family1/77025267dd4a442baf34d051ce6920f6_SeqId_47_ 2023-07-11 17:55:43,359 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/e21925ce9b834d6b8a6dd3506d410b02 first=Optional[r00] last=Optional[r8] 2023-07-11 17:55:43,359 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1689098134208.797d03d17f9b32921e56ea87bcf5ae5e., hostname=jenkins-hbase9.apache.org,45839,1689097999112, seqNum=2 for row with hfile group [{family1,hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/e21925ce9b834d6b8a6dd3506d410b02}] 2023-07-11 17:55:43,362 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(763): Validating hfile at hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/e21925ce9b834d6b8a6dd3506d410b02 for inclusion in 797d03d17f9b32921e56ea87bcf5ae5e/family1 2023-07-11 17:55:43,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(775): HFile bounds: first=r00 last=r8 2023-07-11 17:55:43,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(777): Region bounds: first= last= 2023-07-11 17:55:43,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HRegion(2446): Flush status journal for 797d03d17f9b32921e56ea87bcf5ae5e: 2023-07-11 17:55:43,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/e21925ce9b834d6b8a6dd3506d410b02 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testMinorCompactionWithMonthlyPolicy__4mpdlanuvku6pmgvfhsvr0q2m8kpn30p9flerssk7bteosbiajflmorlet8sf025/family1/e21925ce9b834d6b8a6dd3506d410b02 2023-07-11 17:55:43,367 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testMinorCompactionWithMonthlyPolicy__4mpdlanuvku6pmgvfhsvr0q2m8kpn30p9flerssk7bteosbiajflmorlet8sf025/family1/e21925ce9b834d6b8a6dd3506d410b02 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithMonthlyPolicy/797d03d17f9b32921e56ea87bcf5ae5e/family1/09e149ef13f348ed8618cf188ab04004_SeqId_50_ 2023-07-11 17:55:43,368 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(849): Loaded HFile hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testMinorCompactionWithMonthlyPolicy__4mpdlanuvku6pmgvfhsvr0q2m8kpn30p9flerssk7bteosbiajflmorlet8sf025/family1/e21925ce9b834d6b8a6dd3506d410b02 into 797d03d17f9b32921e56ea87bcf5ae5e/family1 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithMonthlyPolicy/797d03d17f9b32921e56ea87bcf5ae5e/family1/09e149ef13f348ed8618cf188ab04004_SeqId_50_ - updating store file list. 2023-07-11 17:55:43,373 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(882): Loaded HFile hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithMonthlyPolicy/797d03d17f9b32921e56ea87bcf5ae5e/family1/09e149ef13f348ed8618cf188ab04004_SeqId_50_ into 797d03d17f9b32921e56ea87bcf5ae5e/family1 2023-07-11 17:55:43,373 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(855): Successfully loaded hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testMinorCompactionWithMonthlyPolicy__4mpdlanuvku6pmgvfhsvr0q2m8kpn30p9flerssk7bteosbiajflmorlet8sf025/family1/e21925ce9b834d6b8a6dd3506d410b02 into 797d03d17f9b32921e56ea87bcf5ae5e/family1 (new location: hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithMonthlyPolicy/797d03d17f9b32921e56ea87bcf5ae5e/family1/09e149ef13f348ed8618cf188ab04004_SeqId_50_) 2023-07-11 17:55:43,373 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testMinorCompactionWithMonthlyPolicy__4mpdlanuvku6pmgvfhsvr0q2m8kpn30p9flerssk7bteosbiajflmorlet8sf025/family1/e21925ce9b834d6b8a6dd3506d410b02 2023-07-11 17:55:43,376 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-07-11 17:55:43,376 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 17:55:43,378 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511201b2d2d474cb144c089f29f748ade414d to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511201b2d2d474cb144c089f29f748ade414d 2023-07-11 17:55:43,379 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511282d3ef57148c341fb8870f71e8c68dbe5 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511282d3ef57148c341fb8870f71e8c68dbe5 2023-07-11 17:55:43,380 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015113032c4dde36df843758d49bc6a714affdd to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015113032c4dde36df843758d49bc6a714affdd 2023-07-11 17:55:43,380 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 3 expired mob files are deleted 2023-07-11 17:55:43,380 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-07-11 17:55:43,381 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-07-11 17:55:43,381 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-07-11 17:55:43,381 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-07-11 17:55:43,381 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-07-11 17:55:43,381 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] mob.MobUtils(840): end MOB compaction of files for table='testMinorCompactionWithMonthlyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-07-11 17:55:43,383 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=115, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-07-11 17:55:43,385 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=115, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE in 688 msec 2023-07-11 17:55:43,583 INFO [Listener at localhost/43271] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompactionWithMonthlyPolicy Thread=261 (was 258) - Thread LEAK? -, OpenFileDescriptor=649 (was 652), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=266 (was 295), ProcessCount=170 (was 170), AvailableMemoryMB=8620 (was 8044) - AvailableMemoryMB LEAK? - 2023-07-11 17:55:43,597 INFO [Listener at localhost/43271] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionFromAdmin Thread=261, OpenFileDescriptor=649, MaxFileDescriptor=60000, SystemLoadAverage=266, ProcessCount=170, AvailableMemoryMB=8619 2023-07-11 17:55:43,616 DEBUG [Listener at localhost/43271] crypto.Encryption(565): Installed org.apache.hadoop.hbase.io.crypto.KeyProviderForTesting into key provider cache 2023-07-11 17:55:43,671 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10"1\xDC\xFE&\xAE2\x19}\xC475/O6V"\x10\x9C\xF4\x95&\xCDgK\xCAK\x8F_c\x8A\xBDeM*\x10#\xFD\xE1\xC5\x8E;B\xCA\xEC\xF8\xA8{~\xB1\xEA\xD32\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-11 17:55:43,672 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure2.ProcedureExecutor(1029): Stored pid=116, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionFromAdmin 2023-07-11 17:55:43,674 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_PRE_OPERATION 2023-07-11 17:55:43,674 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionFromAdmin" procId is: 116 2023-07-11 17:55:43,674 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-11 17:55:43,675 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-07-11 17:55:43,676 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/.tmp/data/default/testMajorCompactionFromAdmin/810281b0ac113fdf6cb1bc56c9d6fbba 2023-07-11 17:55:43,676 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/.tmp/data/default/testMajorCompactionFromAdmin/0500066ce9a917d77efcb830c43e6a63 2023-07-11 17:55:43,676 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/.tmp/data/default/testMajorCompactionFromAdmin/b38aa2a682bf930d63a6a27ffa681e2e 2023-07-11 17:55:43,677 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/.tmp/data/default/testMajorCompactionFromAdmin/810281b0ac113fdf6cb1bc56c9d6fbba empty. 2023-07-11 17:55:43,677 DEBUG [HFileArchiver-21] backup.HFileArchiver(153): Directory hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/.tmp/data/default/testMajorCompactionFromAdmin/b38aa2a682bf930d63a6a27ffa681e2e empty. 2023-07-11 17:55:43,677 DEBUG [HFileArchiver-22] backup.HFileArchiver(153): Directory hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/.tmp/data/default/testMajorCompactionFromAdmin/0500066ce9a917d77efcb830c43e6a63 empty. 2023-07-11 17:55:43,677 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/.tmp/data/default/testMajorCompactionFromAdmin/810281b0ac113fdf6cb1bc56c9d6fbba 2023-07-11 17:55:43,677 DEBUG [HFileArchiver-21] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/.tmp/data/default/testMajorCompactionFromAdmin/b38aa2a682bf930d63a6a27ffa681e2e 2023-07-11 17:55:43,678 DEBUG [HFileArchiver-22] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/.tmp/data/default/testMajorCompactionFromAdmin/0500066ce9a917d77efcb830c43e6a63 2023-07-11 17:55:43,678 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testMajorCompactionFromAdmin regions 2023-07-11 17:55:43,776 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-07-11 17:55:43,976 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-07-11 17:55:44,090 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/.tmp/data/default/testMajorCompactionFromAdmin/.tabledesc/.tableinfo.0000000001 2023-07-11 17:55:44,092 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(7675): creating {ENCODED => 810281b0ac113fdf6cb1bc56c9d6fbba, NAME => 'testMajorCompactionFromAdmin,,1689098143639.810281b0ac113fdf6cb1bc56c9d6fbba.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10"1\xDC\xFE&\xAE2\x19}\xC475/O6V"\x10\x9C\xF4\x95&\xCDgK\xCAK\x8F_c\x8A\xBDeM*\x10#\xFD\xE1\xC5\x8E;B\xCA\xEC\xF8\xA8{~\xB1\xEA\xD32\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/.tmp 2023-07-11 17:55:44,092 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(7675): creating {ENCODED => 0500066ce9a917d77efcb830c43e6a63, NAME => 'testMajorCompactionFromAdmin,2,1689098143639.0500066ce9a917d77efcb830c43e6a63.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10"1\xDC\xFE&\xAE2\x19}\xC475/O6V"\x10\x9C\xF4\x95&\xCDgK\xCAK\x8F_c\x8A\xBDeM*\x10#\xFD\xE1\xC5\x8E;B\xCA\xEC\xF8\xA8{~\xB1\xEA\xD32\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/.tmp 2023-07-11 17:55:44,092 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(7675): creating {ENCODED => b38aa2a682bf930d63a6a27ffa681e2e, NAME => 'testMajorCompactionFromAdmin,1,1689098143639.b38aa2a682bf930d63a6a27ffa681e2e.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10"1\xDC\xFE&\xAE2\x19}\xC475/O6V"\x10\x9C\xF4\x95&\xCDgK\xCAK\x8F_c\x8A\xBDeM*\x10#\xFD\xE1\xC5\x8E;B\xCA\xEC\xF8\xA8{~\xB1\xEA\xD32\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/.tmp 2023-07-11 17:55:44,105 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,1,1689098143639.b38aa2a682bf930d63a6a27ffa681e2e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 17:55:44,105 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1604): Closing b38aa2a682bf930d63a6a27ffa681e2e, disabling compactions & flushes 2023-07-11 17:55:44,105 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,1,1689098143639.b38aa2a682bf930d63a6a27ffa681e2e. 2023-07-11 17:55:44,105 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,1,1689098143639.b38aa2a682bf930d63a6a27ffa681e2e. 2023-07-11 17:55:44,105 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,1,1689098143639.b38aa2a682bf930d63a6a27ffa681e2e. after waiting 0 ms 2023-07-11 17:55:44,106 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,1,1689098143639.b38aa2a682bf930d63a6a27ffa681e2e. 2023-07-11 17:55:44,106 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,1,1689098143639.b38aa2a682bf930d63a6a27ffa681e2e. 2023-07-11 17:55:44,106 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1558): Region close journal for b38aa2a682bf930d63a6a27ffa681e2e: 2023-07-11 17:55:44,277 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-07-11 17:55:44,505 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,2,1689098143639.0500066ce9a917d77efcb830c43e6a63.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 17:55:44,506 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1604): Closing 0500066ce9a917d77efcb830c43e6a63, disabling compactions & flushes 2023-07-11 17:55:44,506 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,2,1689098143639.0500066ce9a917d77efcb830c43e6a63. 2023-07-11 17:55:44,506 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,2,1689098143639.0500066ce9a917d77efcb830c43e6a63. 2023-07-11 17:55:44,506 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,2,1689098143639.0500066ce9a917d77efcb830c43e6a63. after waiting 0 ms 2023-07-11 17:55:44,506 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,2,1689098143639.0500066ce9a917d77efcb830c43e6a63. 2023-07-11 17:55:44,506 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,2,1689098143639.0500066ce9a917d77efcb830c43e6a63. 2023-07-11 17:55:44,506 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1558): Region close journal for 0500066ce9a917d77efcb830c43e6a63: 2023-07-11 17:55:44,506 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,,1689098143639.810281b0ac113fdf6cb1bc56c9d6fbba.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 17:55:44,506 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1604): Closing 810281b0ac113fdf6cb1bc56c9d6fbba, disabling compactions & flushes 2023-07-11 17:55:44,507 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,,1689098143639.810281b0ac113fdf6cb1bc56c9d6fbba. 2023-07-11 17:55:44,507 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,,1689098143639.810281b0ac113fdf6cb1bc56c9d6fbba. 2023-07-11 17:55:44,507 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,,1689098143639.810281b0ac113fdf6cb1bc56c9d6fbba. after waiting 0 ms 2023-07-11 17:55:44,507 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,,1689098143639.810281b0ac113fdf6cb1bc56c9d6fbba. 2023-07-11 17:55:44,507 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,,1689098143639.810281b0ac113fdf6cb1bc56c9d6fbba. 2023-07-11 17:55:44,507 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1558): Region close journal for 810281b0ac113fdf6cb1bc56c9d6fbba: 2023-07-11 17:55:44,509 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_ADD_TO_META 2023-07-11 17:55:44,510 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,1,1689098143639.b38aa2a682bf930d63a6a27ffa681e2e.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689098144510"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689098144510"}]},"ts":"1689098144510"} 2023-07-11 17:55:44,510 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,2,1689098143639.0500066ce9a917d77efcb830c43e6a63.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1689098144510"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689098144510"}]},"ts":"1689098144510"} 2023-07-11 17:55:44,510 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,,1689098143639.810281b0ac113fdf6cb1bc56c9d6fbba.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1689098144510"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689098144510"}]},"ts":"1689098144510"} 2023-07-11 17:55:44,515 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-07-11 17:55:44,516 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-11 17:55:44,516 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionFromAdmin","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689098144516"}]},"ts":"1689098144516"} 2023-07-11 17:55:44,517 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionFromAdmin, state=ENABLING in hbase:meta 2023-07-11 17:55:44,521 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=810281b0ac113fdf6cb1bc56c9d6fbba, ASSIGN}, {pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=b38aa2a682bf930d63a6a27ffa681e2e, ASSIGN}, {pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=0500066ce9a917d77efcb830c43e6a63, ASSIGN}] 2023-07-11 17:55:44,523 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=810281b0ac113fdf6cb1bc56c9d6fbba, ASSIGN 2023-07-11 17:55:44,523 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=b38aa2a682bf930d63a6a27ffa681e2e, ASSIGN 2023-07-11 17:55:44,523 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=0500066ce9a917d77efcb830c43e6a63, ASSIGN 2023-07-11 17:55:44,524 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=810281b0ac113fdf6cb1bc56c9d6fbba, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,45839,1689097999112; forceNewPlan=false, retain=false 2023-07-11 17:55:44,524 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=b38aa2a682bf930d63a6a27ffa681e2e, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,45839,1689097999112; forceNewPlan=false, retain=false 2023-07-11 17:55:44,524 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=0500066ce9a917d77efcb830c43e6a63, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,45839,1689097999112; forceNewPlan=false, retain=false 2023-07-11 17:55:44,676 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=119 updating hbase:meta row=0500066ce9a917d77efcb830c43e6a63, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:44,676 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=117 updating hbase:meta row=810281b0ac113fdf6cb1bc56c9d6fbba, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:44,676 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,2,1689098143639.0500066ce9a917d77efcb830c43e6a63.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1689098144676"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689098144676"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689098144676"}]},"ts":"1689098144676"} 2023-07-11 17:55:44,676 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=118 updating hbase:meta row=b38aa2a682bf930d63a6a27ffa681e2e, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:44,676 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,,1689098143639.810281b0ac113fdf6cb1bc56c9d6fbba.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1689098144676"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689098144676"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689098144676"}]},"ts":"1689098144676"} 2023-07-11 17:55:44,676 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,1,1689098143639.b38aa2a682bf930d63a6a27ffa681e2e.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689098144676"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689098144676"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689098144676"}]},"ts":"1689098144676"} 2023-07-11 17:55:44,677 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=120, ppid=119, state=RUNNABLE; OpenRegionProcedure 0500066ce9a917d77efcb830c43e6a63, server=jenkins-hbase9.apache.org,45839,1689097999112}] 2023-07-11 17:55:44,678 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=121, ppid=118, state=RUNNABLE; OpenRegionProcedure b38aa2a682bf930d63a6a27ffa681e2e, server=jenkins-hbase9.apache.org,45839,1689097999112}] 2023-07-11 17:55:44,678 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=122, ppid=117, state=RUNNABLE; OpenRegionProcedure 810281b0ac113fdf6cb1bc56c9d6fbba, server=jenkins-hbase9.apache.org,45839,1689097999112}] 2023-07-11 17:55:44,778 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-07-11 17:55:44,831 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionFromAdmin,,1689098143639.810281b0ac113fdf6cb1bc56c9d6fbba. 2023-07-11 17:55:44,831 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 810281b0ac113fdf6cb1bc56c9d6fbba, NAME => 'testMajorCompactionFromAdmin,,1689098143639.810281b0ac113fdf6cb1bc56c9d6fbba.', STARTKEY => '', ENDKEY => '1'} 2023-07-11 17:55:44,831 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin 810281b0ac113fdf6cb1bc56c9d6fbba 2023-07-11 17:55:44,831 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,,1689098143639.810281b0ac113fdf6cb1bc56c9d6fbba.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 17:55:44,832 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 810281b0ac113fdf6cb1bc56c9d6fbba 2023-07-11 17:55:44,832 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 810281b0ac113fdf6cb1bc56c9d6fbba 2023-07-11 17:55:44,853 INFO [StoreOpener-810281b0ac113fdf6cb1bc56c9d6fbba-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 810281b0ac113fdf6cb1bc56c9d6fbba 2023-07-11 17:55:44,854 DEBUG [StoreOpener-810281b0ac113fdf6cb1bc56c9d6fbba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/810281b0ac113fdf6cb1bc56c9d6fbba/family1 2023-07-11 17:55:44,854 DEBUG [StoreOpener-810281b0ac113fdf6cb1bc56c9d6fbba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/810281b0ac113fdf6cb1bc56c9d6fbba/family1 2023-07-11 17:55:44,855 INFO [StoreOpener-810281b0ac113fdf6cb1bc56c9d6fbba-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 810281b0ac113fdf6cb1bc56c9d6fbba columnFamilyName family1 2023-07-11 17:55:44,856 INFO [StoreOpener-810281b0ac113fdf6cb1bc56c9d6fbba-1] regionserver.HStore(310): Store=810281b0ac113fdf6cb1bc56c9d6fbba/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 17:55:44,856 INFO [StoreOpener-810281b0ac113fdf6cb1bc56c9d6fbba-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 810281b0ac113fdf6cb1bc56c9d6fbba 2023-07-11 17:55:44,857 DEBUG [StoreOpener-810281b0ac113fdf6cb1bc56c9d6fbba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/810281b0ac113fdf6cb1bc56c9d6fbba/family2 2023-07-11 17:55:44,857 DEBUG [StoreOpener-810281b0ac113fdf6cb1bc56c9d6fbba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/810281b0ac113fdf6cb1bc56c9d6fbba/family2 2023-07-11 17:55:44,857 INFO [StoreOpener-810281b0ac113fdf6cb1bc56c9d6fbba-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 810281b0ac113fdf6cb1bc56c9d6fbba columnFamilyName family2 2023-07-11 17:55:44,858 INFO [StoreOpener-810281b0ac113fdf6cb1bc56c9d6fbba-1] regionserver.HStore(310): Store=810281b0ac113fdf6cb1bc56c9d6fbba/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 17:55:44,859 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/810281b0ac113fdf6cb1bc56c9d6fbba 2023-07-11 17:55:44,859 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/810281b0ac113fdf6cb1bc56c9d6fbba 2023-07-11 17:55:44,860 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-07-11 17:55:44,861 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 810281b0ac113fdf6cb1bc56c9d6fbba 2023-07-11 17:55:44,862 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/810281b0ac113fdf6cb1bc56c9d6fbba/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 17:55:44,862 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 810281b0ac113fdf6cb1bc56c9d6fbba; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73493078, jitterRate=0.09513220191001892}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-07-11 17:55:44,862 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 810281b0ac113fdf6cb1bc56c9d6fbba: 2023-07-11 17:55:44,863 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionFromAdmin,,1689098143639.810281b0ac113fdf6cb1bc56c9d6fbba., pid=122, masterSystemTime=1689098144829 2023-07-11 17:55:44,864 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionFromAdmin,,1689098143639.810281b0ac113fdf6cb1bc56c9d6fbba. 2023-07-11 17:55:44,864 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionFromAdmin,,1689098143639.810281b0ac113fdf6cb1bc56c9d6fbba. 2023-07-11 17:55:44,864 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionFromAdmin,2,1689098143639.0500066ce9a917d77efcb830c43e6a63. 2023-07-11 17:55:44,864 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0500066ce9a917d77efcb830c43e6a63, NAME => 'testMajorCompactionFromAdmin,2,1689098143639.0500066ce9a917d77efcb830c43e6a63.', STARTKEY => '2', ENDKEY => ''} 2023-07-11 17:55:44,865 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin 0500066ce9a917d77efcb830c43e6a63 2023-07-11 17:55:44,865 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=117 updating hbase:meta row=810281b0ac113fdf6cb1bc56c9d6fbba, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:44,865 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,2,1689098143639.0500066ce9a917d77efcb830c43e6a63.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 17:55:44,865 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,,1689098143639.810281b0ac113fdf6cb1bc56c9d6fbba.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1689098144865"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689098144865"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689098144865"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689098144865"}]},"ts":"1689098144865"} 2023-07-11 17:55:44,865 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 0500066ce9a917d77efcb830c43e6a63 2023-07-11 17:55:44,865 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 0500066ce9a917d77efcb830c43e6a63 2023-07-11 17:55:44,868 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=122, resume processing ppid=117 2023-07-11 17:55:44,868 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=122, ppid=117, state=SUCCESS; OpenRegionProcedure 810281b0ac113fdf6cb1bc56c9d6fbba, server=jenkins-hbase9.apache.org,45839,1689097999112 in 188 msec 2023-07-11 17:55:44,868 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=810281b0ac113fdf6cb1bc56c9d6fbba, ASSIGN in 348 msec 2023-07-11 17:55:44,885 INFO [StoreOpener-0500066ce9a917d77efcb830c43e6a63-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 0500066ce9a917d77efcb830c43e6a63 2023-07-11 17:55:44,887 DEBUG [StoreOpener-0500066ce9a917d77efcb830c43e6a63-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/0500066ce9a917d77efcb830c43e6a63/family1 2023-07-11 17:55:44,887 DEBUG [StoreOpener-0500066ce9a917d77efcb830c43e6a63-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/0500066ce9a917d77efcb830c43e6a63/family1 2023-07-11 17:55:44,887 INFO [StoreOpener-0500066ce9a917d77efcb830c43e6a63-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0500066ce9a917d77efcb830c43e6a63 columnFamilyName family1 2023-07-11 17:55:44,888 INFO [StoreOpener-0500066ce9a917d77efcb830c43e6a63-1] regionserver.HStore(310): Store=0500066ce9a917d77efcb830c43e6a63/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 17:55:44,888 INFO [StoreOpener-0500066ce9a917d77efcb830c43e6a63-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 0500066ce9a917d77efcb830c43e6a63 2023-07-11 17:55:44,889 DEBUG [StoreOpener-0500066ce9a917d77efcb830c43e6a63-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/0500066ce9a917d77efcb830c43e6a63/family2 2023-07-11 17:55:44,889 DEBUG [StoreOpener-0500066ce9a917d77efcb830c43e6a63-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/0500066ce9a917d77efcb830c43e6a63/family2 2023-07-11 17:55:44,889 INFO [StoreOpener-0500066ce9a917d77efcb830c43e6a63-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0500066ce9a917d77efcb830c43e6a63 columnFamilyName family2 2023-07-11 17:55:44,890 INFO [StoreOpener-0500066ce9a917d77efcb830c43e6a63-1] regionserver.HStore(310): Store=0500066ce9a917d77efcb830c43e6a63/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 17:55:44,891 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/0500066ce9a917d77efcb830c43e6a63 2023-07-11 17:55:44,891 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/0500066ce9a917d77efcb830c43e6a63 2023-07-11 17:55:44,892 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-07-11 17:55:44,893 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 0500066ce9a917d77efcb830c43e6a63 2023-07-11 17:55:44,894 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/0500066ce9a917d77efcb830c43e6a63/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 17:55:44,895 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 0500066ce9a917d77efcb830c43e6a63; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75314121, jitterRate=0.12226785719394684}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-07-11 17:55:44,895 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 0500066ce9a917d77efcb830c43e6a63: 2023-07-11 17:55:44,895 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionFromAdmin,2,1689098143639.0500066ce9a917d77efcb830c43e6a63., pid=120, masterSystemTime=1689098144829 2023-07-11 17:55:44,897 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionFromAdmin,2,1689098143639.0500066ce9a917d77efcb830c43e6a63. 2023-07-11 17:55:44,897 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionFromAdmin,2,1689098143639.0500066ce9a917d77efcb830c43e6a63. 2023-07-11 17:55:44,897 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionFromAdmin,1,1689098143639.b38aa2a682bf930d63a6a27ffa681e2e. 2023-07-11 17:55:44,897 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b38aa2a682bf930d63a6a27ffa681e2e, NAME => 'testMajorCompactionFromAdmin,1,1689098143639.b38aa2a682bf930d63a6a27ffa681e2e.', STARTKEY => '1', ENDKEY => '2'} 2023-07-11 17:55:44,897 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=119 updating hbase:meta row=0500066ce9a917d77efcb830c43e6a63, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:44,897 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin b38aa2a682bf930d63a6a27ffa681e2e 2023-07-11 17:55:44,897 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,1,1689098143639.b38aa2a682bf930d63a6a27ffa681e2e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 17:55:44,897 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,2,1689098143639.0500066ce9a917d77efcb830c43e6a63.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1689098144897"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689098144897"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689098144897"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689098144897"}]},"ts":"1689098144897"} 2023-07-11 17:55:44,897 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for b38aa2a682bf930d63a6a27ffa681e2e 2023-07-11 17:55:44,897 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for b38aa2a682bf930d63a6a27ffa681e2e 2023-07-11 17:55:44,899 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=120, resume processing ppid=119 2023-07-11 17:55:44,899 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=120, ppid=119, state=SUCCESS; OpenRegionProcedure 0500066ce9a917d77efcb830c43e6a63, server=jenkins-hbase9.apache.org,45839,1689097999112 in 221 msec 2023-07-11 17:55:44,900 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=119, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=0500066ce9a917d77efcb830c43e6a63, ASSIGN in 379 msec 2023-07-11 17:55:44,918 INFO [StoreOpener-b38aa2a682bf930d63a6a27ffa681e2e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region b38aa2a682bf930d63a6a27ffa681e2e 2023-07-11 17:55:44,920 DEBUG [StoreOpener-b38aa2a682bf930d63a6a27ffa681e2e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/b38aa2a682bf930d63a6a27ffa681e2e/family1 2023-07-11 17:55:44,920 DEBUG [StoreOpener-b38aa2a682bf930d63a6a27ffa681e2e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/b38aa2a682bf930d63a6a27ffa681e2e/family1 2023-07-11 17:55:44,920 INFO [StoreOpener-b38aa2a682bf930d63a6a27ffa681e2e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b38aa2a682bf930d63a6a27ffa681e2e columnFamilyName family1 2023-07-11 17:55:44,921 INFO [StoreOpener-b38aa2a682bf930d63a6a27ffa681e2e-1] regionserver.HStore(310): Store=b38aa2a682bf930d63a6a27ffa681e2e/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 17:55:44,921 INFO [StoreOpener-b38aa2a682bf930d63a6a27ffa681e2e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region b38aa2a682bf930d63a6a27ffa681e2e 2023-07-11 17:55:44,922 DEBUG [StoreOpener-b38aa2a682bf930d63a6a27ffa681e2e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/b38aa2a682bf930d63a6a27ffa681e2e/family2 2023-07-11 17:55:44,922 DEBUG [StoreOpener-b38aa2a682bf930d63a6a27ffa681e2e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/b38aa2a682bf930d63a6a27ffa681e2e/family2 2023-07-11 17:55:44,922 INFO [StoreOpener-b38aa2a682bf930d63a6a27ffa681e2e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b38aa2a682bf930d63a6a27ffa681e2e columnFamilyName family2 2023-07-11 17:55:44,923 INFO [StoreOpener-b38aa2a682bf930d63a6a27ffa681e2e-1] regionserver.HStore(310): Store=b38aa2a682bf930d63a6a27ffa681e2e/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 17:55:44,923 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/b38aa2a682bf930d63a6a27ffa681e2e 2023-07-11 17:55:44,924 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/b38aa2a682bf930d63a6a27ffa681e2e 2023-07-11 17:55:44,925 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-07-11 17:55:44,926 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for b38aa2a682bf930d63a6a27ffa681e2e 2023-07-11 17:55:44,927 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/b38aa2a682bf930d63a6a27ffa681e2e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 17:55:44,928 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened b38aa2a682bf930d63a6a27ffa681e2e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67093523, jitterRate=-2.285987138748169E-4}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-07-11 17:55:44,928 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for b38aa2a682bf930d63a6a27ffa681e2e: 2023-07-11 17:55:44,928 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionFromAdmin,1,1689098143639.b38aa2a682bf930d63a6a27ffa681e2e., pid=121, masterSystemTime=1689098144829 2023-07-11 17:55:44,930 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionFromAdmin,1,1689098143639.b38aa2a682bf930d63a6a27ffa681e2e. 2023-07-11 17:55:44,930 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionFromAdmin,1,1689098143639.b38aa2a682bf930d63a6a27ffa681e2e. 2023-07-11 17:55:44,930 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=118 updating hbase:meta row=b38aa2a682bf930d63a6a27ffa681e2e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:44,930 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,1,1689098143639.b38aa2a682bf930d63a6a27ffa681e2e.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689098144930"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689098144930"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689098144930"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689098144930"}]},"ts":"1689098144930"} 2023-07-11 17:55:44,932 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=121, resume processing ppid=118 2023-07-11 17:55:44,932 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=121, ppid=118, state=SUCCESS; OpenRegionProcedure b38aa2a682bf930d63a6a27ffa681e2e, server=jenkins-hbase9.apache.org,45839,1689097999112 in 253 msec 2023-07-11 17:55:44,933 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=118, resume processing ppid=116 2023-07-11 17:55:44,933 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=b38aa2a682bf930d63a6a27ffa681e2e, ASSIGN in 412 msec 2023-07-11 17:55:44,933 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-11 17:55:44,934 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionFromAdmin","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689098144934"}]},"ts":"1689098144934"} 2023-07-11 17:55:44,934 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionFromAdmin, state=ENABLED in hbase:meta 2023-07-11 17:55:44,936 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_POST_OPERATION 2023-07-11 17:55:44,937 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=116, state=SUCCESS; CreateTableProcedure table=testMajorCompactionFromAdmin in 1.2650 sec 2023-07-11 17:55:45,780 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-07-11 17:55:45,780 INFO [Listener at localhost/43271] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionFromAdmin, procId: 116 completed 2023-07-11 17:55:45,839 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1689098143639.810281b0ac113fdf6cb1bc56c9d6fbba. with WAL disabled. Data may be lost in the event of a crash. 2023-07-11 17:55:45,840 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1689098143639.b38aa2a682bf930d63a6a27ffa681e2e. with WAL disabled. Data may be lost in the event of a crash. 2023-07-11 17:55:45,840 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1689098143639.0500066ce9a917d77efcb830c43e6a63. with WAL disabled. Data may be lost in the event of a crash. 2023-07-11 17:55:45,843 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 17:55:45,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-07-11 17:55:45,852 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-07-11 17:55:45,852 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:55:45,852 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-07-11 17:55:45,852 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-07-11 17:55:45,853 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-07-11 17:55:45,853 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-07-11 17:55:45,859 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:45,859 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:55:45,859 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:55:45,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:55:45,859 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:45,860 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 17:55:45,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-07-11 17:55:45,860 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-07-11 17:55:45,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 17:55:45,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-07-11 17:55:45,861 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-07-11 17:55:45,872 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-07-11 17:55:45,872 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-07-11 17:55:45,872 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:55:45,872 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-07-11 17:55:45,888 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1689098143639.810281b0ac113fdf6cb1bc56c9d6fbba. 2023-07-11 17:55:45,888 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1689098143639.810281b0ac113fdf6cb1bc56c9d6fbba. started... 2023-07-11 17:55:45,889 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1689098143639.b38aa2a682bf930d63a6a27ffa681e2e. 2023-07-11 17:55:45,889 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1689098143639.b38aa2a682bf930d63a6a27ffa681e2e. started... 2023-07-11 17:55:45,899 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-07-11 17:55:45,899 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 17:55:45,903 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 810281b0ac113fdf6cb1bc56c9d6fbba 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-07-11 17:55:45,903 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1689098143639.0500066ce9a917d77efcb830c43e6a63. 2023-07-11 17:55:45,903 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1689098143639.0500066ce9a917d77efcb830c43e6a63. started... 2023-07-11 17:55:45,905 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 0500066ce9a917d77efcb830c43e6a63 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-07-11 17:55:45,905 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing b38aa2a682bf930d63a6a27ffa681e2e 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-07-11 17:55:46,093 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307110c24d70506a74a949c849880ba77dd21 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202307110c24d70506a74a949c849880ba77dd21 2023-07-11 17:55:46,147 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230711bfb03745089248fa9d903c823ecedd2c to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230711bfb03745089248fa9d903c823ecedd2c 2023-07-11 17:55:46,173 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/810281b0ac113fdf6cb1bc56c9d6fbba/.tmp/family1/a08d0430401d490b8e5c2eeb0c3ab543 2023-07-11 17:55:46,325 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230711b82019aba7dd49ffbfad6e21cf942c55 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20230711b82019aba7dd49ffbfad6e21cf942c55 2023-07-11 17:55:46,350 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/810281b0ac113fdf6cb1bc56c9d6fbba/.tmp/family2/3a83a367730c4267a13afc47f735cd08 2023-07-11 17:55:46,355 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/810281b0ac113fdf6cb1bc56c9d6fbba/.tmp/family1/a08d0430401d490b8e5c2eeb0c3ab543 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/810281b0ac113fdf6cb1bc56c9d6fbba/family1/a08d0430401d490b8e5c2eeb0c3ab543 2023-07-11 17:55:46,394 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/810281b0ac113fdf6cb1bc56c9d6fbba/family1/a08d0430401d490b8e5c2eeb0c3ab543, entries=4, sequenceid=5, filesize=5.5 K 2023-07-11 17:55:46,395 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/810281b0ac113fdf6cb1bc56c9d6fbba/.tmp/family2/3a83a367730c4267a13afc47f735cd08 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/810281b0ac113fdf6cb1bc56c9d6fbba/family2/3a83a367730c4267a13afc47f735cd08 2023-07-11 17:55:46,402 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/810281b0ac113fdf6cb1bc56c9d6fbba/family2/3a83a367730c4267a13afc47f735cd08, entries=2, sequenceid=5, filesize=5.1 K 2023-07-11 17:55:46,403 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 810281b0ac113fdf6cb1bc56c9d6fbba in 501ms, sequenceid=5, compaction requested=false 2023-07-11 17:55:46,403 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionFromAdmin' 2023-07-11 17:55:46,405 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 810281b0ac113fdf6cb1bc56c9d6fbba: 2023-07-11 17:55:46,405 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1689098143639.810281b0ac113fdf6cb1bc56c9d6fbba. 2023-07-11 17:55:46,405 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-07-11 17:55:46,474 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202307110798dff452924f9dbd32a2740a837c38 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202307110798dff452924f9dbd32a2740a837c38 2023-07-11 17:55:46,538 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/b38aa2a682bf930d63a6a27ffa681e2e/.tmp/family1/469149fe29954bf08202a88335c53fd5 2023-07-11 17:55:46,608 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/0500066ce9a917d77efcb830c43e6a63/.tmp/family1/df8dc251c1264b729ad2d9318a72dfd9 2023-07-11 17:55:46,641 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230711c0df3d3474724f63903cd87d6c0e0223 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b20230711c0df3d3474724f63903cd87d6c0e0223 2023-07-11 17:55:46,652 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/b38aa2a682bf930d63a6a27ffa681e2e/.tmp/family2/4f8322a6816a43ff87c8edabcd21f9cb 2023-07-11 17:55:46,659 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/b38aa2a682bf930d63a6a27ffa681e2e/.tmp/family1/469149fe29954bf08202a88335c53fd5 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/b38aa2a682bf930d63a6a27ffa681e2e/family1/469149fe29954bf08202a88335c53fd5 2023-07-11 17:55:46,704 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/b38aa2a682bf930d63a6a27ffa681e2e/family1/469149fe29954bf08202a88335c53fd5, entries=4, sequenceid=5, filesize=5.5 K 2023-07-11 17:55:46,705 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/b38aa2a682bf930d63a6a27ffa681e2e/.tmp/family2/4f8322a6816a43ff87c8edabcd21f9cb as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/b38aa2a682bf930d63a6a27ffa681e2e/family2/4f8322a6816a43ff87c8edabcd21f9cb 2023-07-11 17:55:46,715 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/b38aa2a682bf930d63a6a27ffa681e2e/family2/4f8322a6816a43ff87c8edabcd21f9cb, entries=2, sequenceid=5, filesize=5.1 K 2023-07-11 17:55:46,716 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for b38aa2a682bf930d63a6a27ffa681e2e in 812ms, sequenceid=5, compaction requested=false 2023-07-11 17:55:46,718 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for b38aa2a682bf930d63a6a27ffa681e2e: 2023-07-11 17:55:46,718 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1689098143639.b38aa2a682bf930d63a6a27ffa681e2e. 2023-07-11 17:55:46,718 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-07-11 17:55:47,103 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230711df527df2e8ff4fa2acd4899fee373b5b to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20230711df527df2e8ff4fa2acd4899fee373b5b 2023-07-11 17:55:47,145 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/0500066ce9a917d77efcb830c43e6a63/.tmp/family2/26dfbe695db94da3b0c3454a7e2078e6 2023-07-11 17:55:47,152 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/0500066ce9a917d77efcb830c43e6a63/.tmp/family1/df8dc251c1264b729ad2d9318a72dfd9 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/0500066ce9a917d77efcb830c43e6a63/family1/df8dc251c1264b729ad2d9318a72dfd9 2023-07-11 17:55:47,194 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/0500066ce9a917d77efcb830c43e6a63/family1/df8dc251c1264b729ad2d9318a72dfd9, entries=4, sequenceid=5, filesize=5.5 K 2023-07-11 17:55:47,195 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/0500066ce9a917d77efcb830c43e6a63/.tmp/family2/26dfbe695db94da3b0c3454a7e2078e6 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/0500066ce9a917d77efcb830c43e6a63/family2/26dfbe695db94da3b0c3454a7e2078e6 2023-07-11 17:55:47,203 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/0500066ce9a917d77efcb830c43e6a63/family2/26dfbe695db94da3b0c3454a7e2078e6, entries=2, sequenceid=5, filesize=5.1 K 2023-07-11 17:55:47,205 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 0500066ce9a917d77efcb830c43e6a63 in 1299ms, sequenceid=5, compaction requested=false 2023-07-11 17:55:47,205 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 0500066ce9a917d77efcb830c43e6a63: 2023-07-11 17:55:47,205 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1689098143639.0500066ce9a917d77efcb830c43e6a63. 2023-07-11 17:55:47,205 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-07-11 17:55:47,205 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-07-11 17:55:47,205 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:47,205 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-07-11 17:55:47,205 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-07-11 17:55:47,207 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:47,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:47,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:55:47,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:55:47,207 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-07-11 17:55:47,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:55:47,208 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-07-11 17:55:47,208 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 17:55:47,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:55:47,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-07-11 17:55:47,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:47,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:55:47,210 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-07-11 17:55:47,210 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@74b48e2d[Count = 0] remaining members to acquire global barrier 2023-07-11 17:55:47,210 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-07-11 17:55:47,210 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-07-11 17:55:47,211 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-07-11 17:55:47,211 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-07-11 17:55:47,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-07-11 17:55:47,212 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-07-11 17:55:47,212 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-07-11 17:55:47,212 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase9.apache.org,45839,1689097999112' in zk 2023-07-11 17:55:47,212 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:47,212 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 17:55:47,214 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-07-11 17:55:47,214 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:55:47,214 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-07-11 17:55:47,214 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:47,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:47,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:55:47,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:55:47,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:55:47,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:55:47,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-07-11 17:55:47,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:47,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:55:47,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-07-11 17:55:47,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:47,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase9.apache.org,45839,1689097999112': 2023-07-11 17:55:47,219 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-07-11 17:55:47,219 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-07-11 17:55:47,219 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 17:55:47,219 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 17:55:47,219 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-07-11 17:55:47,219 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 17:55:47,223 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-07-11 17:55:47,223 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:55:47,223 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-07-11 17:55:47,223 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-07-11 17:55:47,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-07-11 17:55:47,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:55:47,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:55:47,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-07-11 17:55:47,223 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:55:47,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:55:47,224 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:47,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-07-11 17:55:47,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:55:47,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-07-11 17:55:47,226 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:47,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:55:47,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-07-11 17:55:47,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:47,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:55:47,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-07-11 17:55:47,231 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:55:47,231 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:55:47,231 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:47,231 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:55:47,231 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:55:47,231 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-07-11 17:55:47,231 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 17:55:47,231 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-07-11 17:55:47,232 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 17:55:47,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:55:47,231 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-07-11 17:55:47,232 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-07-11 17:55:47,232 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:47,232 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-07-11 17:55:47,232 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-07-11 17:55:47,232 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-07-11 17:55:47,232 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-07-11 17:55:47,232 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:55:47,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:55:47,332 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 17:55:47,333 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 17:55:47,334 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1689098143639.810281b0ac113fdf6cb1bc56c9d6fbba. with WAL disabled. Data may be lost in the event of a crash. 2023-07-11 17:55:47,335 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1689098143639.b38aa2a682bf930d63a6a27ffa681e2e. with WAL disabled. Data may be lost in the event of a crash. 2023-07-11 17:55:47,335 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1689098143639.0500066ce9a917d77efcb830c43e6a63. with WAL disabled. Data may be lost in the event of a crash. 2023-07-11 17:55:47,338 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 17:55:47,342 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-07-11 17:55:47,343 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-07-11 17:55:47,343 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-07-11 17:55:47,343 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:55:47,343 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-07-11 17:55:47,343 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-07-11 17:55:47,343 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-07-11 17:55:47,343 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-07-11 17:55:47,345 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:47,345 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:55:47,345 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:55:47,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:55:47,345 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:47,345 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 17:55:47,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-07-11 17:55:47,346 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-07-11 17:55:47,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 17:55:47,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-07-11 17:55:47,347 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-07-11 17:55:47,352 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-07-11 17:55:47,352 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-07-11 17:55:47,352 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-07-11 17:55:47,352 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:55:47,352 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-07-11 17:55:47,353 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1689098143639.810281b0ac113fdf6cb1bc56c9d6fbba. 2023-07-11 17:55:47,353 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1689098143639.810281b0ac113fdf6cb1bc56c9d6fbba. started... 2023-07-11 17:55:47,354 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 810281b0ac113fdf6cb1bc56c9d6fbba 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-07-11 17:55:47,361 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1689098143639.b38aa2a682bf930d63a6a27ffa681e2e. 2023-07-11 17:55:47,361 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1689098143639.b38aa2a682bf930d63a6a27ffa681e2e. started... 2023-07-11 17:55:47,361 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing b38aa2a682bf930d63a6a27ffa681e2e 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-07-11 17:55:47,373 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-07-11 17:55:47,374 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1689098143639.0500066ce9a917d77efcb830c43e6a63. 2023-07-11 17:55:47,374 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1689098143639.0500066ce9a917d77efcb830c43e6a63. started... 2023-07-11 17:55:47,374 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 0500066ce9a917d77efcb830c43e6a63 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-07-11 17:55:47,374 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 17:55:47,522 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307112945e21be35a413eb196d6891e0da185 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202307112945e21be35a413eb196d6891e0da185 2023-07-11 17:55:47,522 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202307118445fbfeb9e74bd1af390f18fc2db17c to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202307118445fbfeb9e74bd1af390f18fc2db17c 2023-07-11 17:55:47,524 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230711b1d0db3a5ac3462cb8bec951e0fc88b2 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230711b1d0db3a5ac3462cb8bec951e0fc88b2 2023-07-11 17:55:47,608 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/b38aa2a682bf930d63a6a27ffa681e2e/.tmp/family1/0a54681d47e641b991e7ebc8a9836244 2023-07-11 17:55:47,696 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230711c9804ecfa5e0482391b7a963d1a58b65 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b20230711c9804ecfa5e0482391b7a963d1a58b65 2023-07-11 17:55:47,731 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/b38aa2a682bf930d63a6a27ffa681e2e/.tmp/family2/76f927abfd8f452e932d3cc8bd37e6af 2023-07-11 17:55:47,736 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/b38aa2a682bf930d63a6a27ffa681e2e/.tmp/family1/0a54681d47e641b991e7ebc8a9836244 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/b38aa2a682bf930d63a6a27ffa681e2e/family1/0a54681d47e641b991e7ebc8a9836244 2023-07-11 17:55:47,805 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/b38aa2a682bf930d63a6a27ffa681e2e/family1/0a54681d47e641b991e7ebc8a9836244, entries=4, sequenceid=9, filesize=5.5 K 2023-07-11 17:55:47,806 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/b38aa2a682bf930d63a6a27ffa681e2e/.tmp/family2/76f927abfd8f452e932d3cc8bd37e6af as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/b38aa2a682bf930d63a6a27ffa681e2e/family2/76f927abfd8f452e932d3cc8bd37e6af 2023-07-11 17:55:47,812 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/b38aa2a682bf930d63a6a27ffa681e2e/family2/76f927abfd8f452e932d3cc8bd37e6af, entries=2, sequenceid=9, filesize=5.1 K 2023-07-11 17:55:47,813 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for b38aa2a682bf930d63a6a27ffa681e2e in 452ms, sequenceid=9, compaction requested=false 2023-07-11 17:55:47,814 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for b38aa2a682bf930d63a6a27ffa681e2e: 2023-07-11 17:55:47,814 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1689098143639.b38aa2a682bf930d63a6a27ffa681e2e. 2023-07-11 17:55:47,814 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-07-11 17:55:48,036 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/810281b0ac113fdf6cb1bc56c9d6fbba/.tmp/family1/1cc4cea715994cabb11023a9d5a561f9 2023-07-11 17:55:48,039 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/0500066ce9a917d77efcb830c43e6a63/.tmp/family1/6e0c7f87b10a4942ab1ecf9fae2397bd 2023-07-11 17:55:48,069 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230711a91196a340f34cb39415d50b4c99505a to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20230711a91196a340f34cb39415d50b4c99505a 2023-07-11 17:55:48,469 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230711c86924a1434b4286b66e175c268344db to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20230711c86924a1434b4286b66e175c268344db 2023-07-11 17:55:48,474 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/0500066ce9a917d77efcb830c43e6a63/.tmp/family2/0898f7ab37654fbe8f59c41a8de31766 2023-07-11 17:55:48,477 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/0500066ce9a917d77efcb830c43e6a63/.tmp/family1/6e0c7f87b10a4942ab1ecf9fae2397bd as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/0500066ce9a917d77efcb830c43e6a63/family1/6e0c7f87b10a4942ab1ecf9fae2397bd 2023-07-11 17:55:48,502 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/0500066ce9a917d77efcb830c43e6a63/family1/6e0c7f87b10a4942ab1ecf9fae2397bd, entries=4, sequenceid=9, filesize=5.5 K 2023-07-11 17:55:48,502 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/0500066ce9a917d77efcb830c43e6a63/.tmp/family2/0898f7ab37654fbe8f59c41a8de31766 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/0500066ce9a917d77efcb830c43e6a63/family2/0898f7ab37654fbe8f59c41a8de31766 2023-07-11 17:55:48,506 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/0500066ce9a917d77efcb830c43e6a63/family2/0898f7ab37654fbe8f59c41a8de31766, entries=2, sequenceid=9, filesize=5.1 K 2023-07-11 17:55:48,507 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 0500066ce9a917d77efcb830c43e6a63 in 1133ms, sequenceid=9, compaction requested=false 2023-07-11 17:55:48,507 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 0500066ce9a917d77efcb830c43e6a63: 2023-07-11 17:55:48,507 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1689098143639.0500066ce9a917d77efcb830c43e6a63. 2023-07-11 17:55:48,507 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-07-11 17:55:48,875 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/810281b0ac113fdf6cb1bc56c9d6fbba/.tmp/family2/2b1182b12a794ea79a8a889f285c7c09 2023-07-11 17:55:48,880 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/810281b0ac113fdf6cb1bc56c9d6fbba/.tmp/family1/1cc4cea715994cabb11023a9d5a561f9 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/810281b0ac113fdf6cb1bc56c9d6fbba/family1/1cc4cea715994cabb11023a9d5a561f9 2023-07-11 17:55:48,902 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/810281b0ac113fdf6cb1bc56c9d6fbba/family1/1cc4cea715994cabb11023a9d5a561f9, entries=4, sequenceid=9, filesize=5.5 K 2023-07-11 17:55:48,903 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/810281b0ac113fdf6cb1bc56c9d6fbba/.tmp/family2/2b1182b12a794ea79a8a889f285c7c09 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/810281b0ac113fdf6cb1bc56c9d6fbba/family2/2b1182b12a794ea79a8a889f285c7c09 2023-07-11 17:55:48,906 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/810281b0ac113fdf6cb1bc56c9d6fbba/family2/2b1182b12a794ea79a8a889f285c7c09, entries=2, sequenceid=9, filesize=5.1 K 2023-07-11 17:55:48,907 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 810281b0ac113fdf6cb1bc56c9d6fbba in 1553ms, sequenceid=9, compaction requested=false 2023-07-11 17:55:48,907 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 810281b0ac113fdf6cb1bc56c9d6fbba: 2023-07-11 17:55:48,907 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1689098143639.810281b0ac113fdf6cb1bc56c9d6fbba. 2023-07-11 17:55:48,907 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-07-11 17:55:48,907 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-07-11 17:55:48,907 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:48,907 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-07-11 17:55:48,907 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-07-11 17:55:48,908 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-07-11 17:55:48,908 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:48,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:48,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:55:48,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:55:48,909 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-07-11 17:55:48,909 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 17:55:48,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:55:48,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:55:48,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-07-11 17:55:48,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:48,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:55:48,910 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-07-11 17:55:48,910 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@60aae0ad[Count = 0] remaining members to acquire global barrier 2023-07-11 17:55:48,910 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-07-11 17:55:48,910 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-07-11 17:55:48,912 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-07-11 17:55:48,913 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-07-11 17:55:48,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-07-11 17:55:48,913 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-07-11 17:55:48,913 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-07-11 17:55:48,913 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase9.apache.org,45839,1689097999112' in zk 2023-07-11 17:55:48,913 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:48,913 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 17:55:48,914 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-07-11 17:55:48,914 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:55:48,914 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:48,914 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-07-11 17:55:48,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:48,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:55:48,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:55:48,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:55:48,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:55:48,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-07-11 17:55:48,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:48,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:55:48,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-07-11 17:55:48,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:48,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase9.apache.org,45839,1689097999112': 2023-07-11 17:55:48,916 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-07-11 17:55:48,916 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-07-11 17:55:48,916 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 17:55:48,916 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 17:55:48,916 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-07-11 17:55:48,916 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 17:55:48,917 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-07-11 17:55:48,917 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-07-11 17:55:48,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-07-11 17:55:48,917 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-07-11 17:55:48,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:55:48,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:55:48,917 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:55:48,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-07-11 17:55:48,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:55:48,918 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:48,918 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:55:48,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:55:48,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-07-11 17:55:48,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-07-11 17:55:48,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:55:48,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-07-11 17:55:48,919 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:48,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:48,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:55:48,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-07-11 17:55:48,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:48,921 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:48,921 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:55:48,921 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-07-11 17:55:48,921 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-07-11 17:55:48,921 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 17:55:48,921 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-07-11 17:55:48,921 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-07-11 17:55:48,921 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:55:48,921 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:48,921 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:55:48,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:55:48,921 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-07-11 17:55:48,921 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:55:48,921 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 17:55:48,921 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-07-11 17:55:48,921 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:55:48,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:55:48,922 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-07-11 17:55:48,922 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-07-11 17:55:49,022 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 17:55:49,023 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 17:55:49,024 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1689098143639.810281b0ac113fdf6cb1bc56c9d6fbba. with WAL disabled. Data may be lost in the event of a crash. 2023-07-11 17:55:49,024 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1689098143639.b38aa2a682bf930d63a6a27ffa681e2e. with WAL disabled. Data may be lost in the event of a crash. 2023-07-11 17:55:49,024 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1689098143639.0500066ce9a917d77efcb830c43e6a63. with WAL disabled. Data may be lost in the event of a crash. 2023-07-11 17:55:49,026 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 17:55:49,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-07-11 17:55:49,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-07-11 17:55:49,028 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-07-11 17:55:49,028 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:55:49,028 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-07-11 17:55:49,028 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-07-11 17:55:49,028 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-07-11 17:55:49,028 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-07-11 17:55:49,030 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:49,030 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:55:49,030 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:55:49,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:55:49,030 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:49,030 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 17:55:49,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-07-11 17:55:49,031 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-07-11 17:55:49,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 17:55:49,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-07-11 17:55:49,031 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-07-11 17:55:49,031 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-07-11 17:55:49,031 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-07-11 17:55:49,031 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-07-11 17:55:49,031 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:55:49,031 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-07-11 17:55:49,032 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1689098143639.810281b0ac113fdf6cb1bc56c9d6fbba. 2023-07-11 17:55:49,032 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1689098143639.810281b0ac113fdf6cb1bc56c9d6fbba. started... 2023-07-11 17:55:49,032 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1689098143639.b38aa2a682bf930d63a6a27ffa681e2e. 2023-07-11 17:55:49,032 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1689098143639.b38aa2a682bf930d63a6a27ffa681e2e. started... 2023-07-11 17:55:49,032 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1689098143639.0500066ce9a917d77efcb830c43e6a63. 2023-07-11 17:55:49,032 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-07-11 17:55:49,032 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 17:55:49,032 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing b38aa2a682bf930d63a6a27ffa681e2e 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-07-11 17:55:49,032 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1689098143639.0500066ce9a917d77efcb830c43e6a63. started... 2023-07-11 17:55:49,032 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 810281b0ac113fdf6cb1bc56c9d6fbba 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-07-11 17:55:49,032 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 0500066ce9a917d77efcb830c43e6a63 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-07-11 17:55:49,475 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230711c7a15a652d37413b9ddb7f103356d8c6 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230711c7a15a652d37413b9ddb7f103356d8c6 2023-07-11 17:55:49,477 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202307114fcd2ca1b0f14e11bf27cf7b468c85a1 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202307114fcd2ca1b0f14e11bf27cf7b468c85a1 2023-07-11 17:55:49,478 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230711061fb63ad8e34e1d876c39b69dda0372 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230711061fb63ad8e34e1d876c39b69dda0372 2023-07-11 17:55:49,494 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/810281b0ac113fdf6cb1bc56c9d6fbba/.tmp/family1/c86c3ab80f0646bf9c23a46ba43e5711 2023-07-11 17:55:49,497 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/0500066ce9a917d77efcb830c43e6a63/.tmp/family1/3c0ca99687ff4f44a76882b5ceb7fe4b 2023-07-11 17:55:49,541 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230711a295339c03504ea488d8218878144ad3 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20230711a295339c03504ea488d8218878144ad3 2023-07-11 17:55:49,899 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/b38aa2a682bf930d63a6a27ffa681e2e/.tmp/family1/a432a79563bb4abe98100c67f4f6bc72 2023-07-11 17:55:49,939 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230711cb98c4d1349e4cfcaae8e31fe7d38cc6 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20230711cb98c4d1349e4cfcaae8e31fe7d38cc6 2023-07-11 17:55:49,949 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/0500066ce9a917d77efcb830c43e6a63/.tmp/family2/e09b6d21bf37488c961dc2388b223557 2023-07-11 17:55:49,951 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/810281b0ac113fdf6cb1bc56c9d6fbba/.tmp/family2/bf59dc8ac8c54785b0d3ba9505cfad3a 2023-07-11 17:55:49,954 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/0500066ce9a917d77efcb830c43e6a63/.tmp/family1/3c0ca99687ff4f44a76882b5ceb7fe4b as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/0500066ce9a917d77efcb830c43e6a63/family1/3c0ca99687ff4f44a76882b5ceb7fe4b 2023-07-11 17:55:49,955 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/810281b0ac113fdf6cb1bc56c9d6fbba/.tmp/family1/c86c3ab80f0646bf9c23a46ba43e5711 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/810281b0ac113fdf6cb1bc56c9d6fbba/family1/c86c3ab80f0646bf9c23a46ba43e5711 2023-07-11 17:55:49,980 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/810281b0ac113fdf6cb1bc56c9d6fbba/family1/c86c3ab80f0646bf9c23a46ba43e5711, entries=4, sequenceid=13, filesize=5.5 K 2023-07-11 17:55:49,981 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/810281b0ac113fdf6cb1bc56c9d6fbba/.tmp/family2/bf59dc8ac8c54785b0d3ba9505cfad3a as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/810281b0ac113fdf6cb1bc56c9d6fbba/family2/bf59dc8ac8c54785b0d3ba9505cfad3a 2023-07-11 17:55:49,984 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/0500066ce9a917d77efcb830c43e6a63/family1/3c0ca99687ff4f44a76882b5ceb7fe4b, entries=4, sequenceid=13, filesize=5.5 K 2023-07-11 17:55:49,985 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/810281b0ac113fdf6cb1bc56c9d6fbba/family2/bf59dc8ac8c54785b0d3ba9505cfad3a, entries=2, sequenceid=13, filesize=5.1 K 2023-07-11 17:55:49,986 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 810281b0ac113fdf6cb1bc56c9d6fbba in 954ms, sequenceid=13, compaction requested=true 2023-07-11 17:55:49,986 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 810281b0ac113fdf6cb1bc56c9d6fbba: 2023-07-11 17:55:49,986 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1689098143639.810281b0ac113fdf6cb1bc56c9d6fbba. 2023-07-11 17:55:49,986 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-07-11 17:55:49,991 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/0500066ce9a917d77efcb830c43e6a63/.tmp/family2/e09b6d21bf37488c961dc2388b223557 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/0500066ce9a917d77efcb830c43e6a63/family2/e09b6d21bf37488c961dc2388b223557 2023-07-11 17:55:49,994 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/0500066ce9a917d77efcb830c43e6a63/family2/e09b6d21bf37488c961dc2388b223557, entries=2, sequenceid=13, filesize=5.1 K 2023-07-11 17:55:49,995 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 0500066ce9a917d77efcb830c43e6a63 in 963ms, sequenceid=13, compaction requested=true 2023-07-11 17:55:49,995 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 0500066ce9a917d77efcb830c43e6a63: 2023-07-11 17:55:49,995 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1689098143639.0500066ce9a917d77efcb830c43e6a63. 2023-07-11 17:55:49,995 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-07-11 17:55:50,333 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-07-11 17:55:50,335 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202307114337b0c901644f82ac1a64e06dde8b42 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b202307114337b0c901644f82ac1a64e06dde8b42 2023-07-11 17:55:50,343 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/b38aa2a682bf930d63a6a27ffa681e2e/.tmp/family2/e682ff1c9fd8448180db103ab501927a 2023-07-11 17:55:50,348 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/b38aa2a682bf930d63a6a27ffa681e2e/.tmp/family1/a432a79563bb4abe98100c67f4f6bc72 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/b38aa2a682bf930d63a6a27ffa681e2e/family1/a432a79563bb4abe98100c67f4f6bc72 2023-07-11 17:55:50,375 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/b38aa2a682bf930d63a6a27ffa681e2e/family1/a432a79563bb4abe98100c67f4f6bc72, entries=4, sequenceid=13, filesize=5.5 K 2023-07-11 17:55:50,376 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/b38aa2a682bf930d63a6a27ffa681e2e/.tmp/family2/e682ff1c9fd8448180db103ab501927a as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/b38aa2a682bf930d63a6a27ffa681e2e/family2/e682ff1c9fd8448180db103ab501927a 2023-07-11 17:55:50,383 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/b38aa2a682bf930d63a6a27ffa681e2e/family2/e682ff1c9fd8448180db103ab501927a, entries=2, sequenceid=13, filesize=5.1 K 2023-07-11 17:55:50,384 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for b38aa2a682bf930d63a6a27ffa681e2e in 1352ms, sequenceid=13, compaction requested=true 2023-07-11 17:55:50,384 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for b38aa2a682bf930d63a6a27ffa681e2e: 2023-07-11 17:55:50,384 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1689098143639.b38aa2a682bf930d63a6a27ffa681e2e. 2023-07-11 17:55:50,384 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-07-11 17:55:50,384 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-07-11 17:55:50,384 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:50,384 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-07-11 17:55:50,384 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-07-11 17:55:50,386 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-07-11 17:55:50,387 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:50,387 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-07-11 17:55:50,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:50,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:55:50,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:55:50,387 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 17:55:50,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:55:50,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:55:50,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-07-11 17:55:50,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:50,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:55:50,388 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-07-11 17:55:50,389 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2947c0ae[Count = 0] remaining members to acquire global barrier 2023-07-11 17:55:50,389 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-07-11 17:55:50,389 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-07-11 17:55:50,391 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-07-11 17:55:50,391 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-07-11 17:55:50,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-07-11 17:55:50,391 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-07-11 17:55:50,391 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-07-11 17:55:50,391 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase9.apache.org,45839,1689097999112' in zk 2023-07-11 17:55:50,391 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:50,391 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 17:55:50,392 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:50,392 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-07-11 17:55:50,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:50,393 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:55:50,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:55:50,393 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-07-11 17:55:50,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:55:50,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:55:50,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:55:50,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-07-11 17:55:50,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:50,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:55:50,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-07-11 17:55:50,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:50,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase9.apache.org,45839,1689097999112': 2023-07-11 17:55:50,396 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-07-11 17:55:50,396 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-07-11 17:55:50,396 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 17:55:50,396 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 17:55:50,396 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-07-11 17:55:50,396 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 17:55:50,397 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-07-11 17:55:50,398 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-07-11 17:55:50,398 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:55:50,398 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-07-11 17:55:50,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-07-11 17:55:50,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:55:50,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:55:50,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-07-11 17:55:50,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:55:50,398 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:55:50,398 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:50,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:55:50,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-07-11 17:55:50,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-07-11 17:55:50,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:55:50,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-07-11 17:55:50,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:50,400 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:50,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:55:50,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-07-11 17:55:50,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:50,402 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:55:50,402 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:50,403 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:55:50,403 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:55:50,403 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:55:50,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:55:50,403 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-07-11 17:55:50,403 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 17:55:50,403 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-07-11 17:55:50,403 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-07-11 17:55:50,403 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:50,403 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-07-11 17:55:50,403 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-07-11 17:55:50,403 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-07-11 17:55:50,403 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:55:50,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:55:50,403 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-07-11 17:55:50,403 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 17:55:50,503 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 17:55:50,504 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 17:55:50,505 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1689098143639.810281b0ac113fdf6cb1bc56c9d6fbba. with WAL disabled. Data may be lost in the event of a crash. 2023-07-11 17:55:50,505 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1689098143639.b38aa2a682bf930d63a6a27ffa681e2e. with WAL disabled. Data may be lost in the event of a crash. 2023-07-11 17:55:50,506 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1689098143639.0500066ce9a917d77efcb830c43e6a63. with WAL disabled. Data may be lost in the event of a crash. 2023-07-11 17:55:50,508 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 17:55:50,509 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-07-11 17:55:50,509 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-07-11 17:55:50,509 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-07-11 17:55:50,509 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:55:50,509 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-07-11 17:55:50,509 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-07-11 17:55:50,510 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-07-11 17:55:50,510 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-07-11 17:55:50,514 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:50,514 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:55:50,514 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:55:50,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:55:50,515 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:50,515 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 17:55:50,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-07-11 17:55:50,515 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-07-11 17:55:50,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 17:55:50,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-07-11 17:55:50,515 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-07-11 17:55:50,516 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-07-11 17:55:50,516 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-07-11 17:55:50,516 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-07-11 17:55:50,516 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:55:50,516 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-07-11 17:55:50,516 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1689098143639.810281b0ac113fdf6cb1bc56c9d6fbba. 2023-07-11 17:55:50,516 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1689098143639.810281b0ac113fdf6cb1bc56c9d6fbba. started... 2023-07-11 17:55:50,516 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 810281b0ac113fdf6cb1bc56c9d6fbba 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-07-11 17:55:50,521 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1689098143639.b38aa2a682bf930d63a6a27ffa681e2e. 2023-07-11 17:55:50,522 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1689098143639.b38aa2a682bf930d63a6a27ffa681e2e. started... 2023-07-11 17:55:50,522 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing b38aa2a682bf930d63a6a27ffa681e2e 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-07-11 17:55:50,522 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-07-11 17:55:50,522 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 17:55:50,522 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1689098143639.0500066ce9a917d77efcb830c43e6a63. 2023-07-11 17:55:50,522 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1689098143639.0500066ce9a917d77efcb830c43e6a63. started... 2023-07-11 17:55:50,522 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 0500066ce9a917d77efcb830c43e6a63 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-07-11 17:55:50,975 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230711394adb95ee5f4fb995a063f7bc1b8f3f to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230711394adb95ee5f4fb995a063f7bc1b8f3f 2023-07-11 17:55:50,976 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202307112c8377c1ec9d418f82857ae6af82e65c to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202307112c8377c1ec9d418f82857ae6af82e65c 2023-07-11 17:55:50,979 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023071175e95ccad074427b8c635425fdd8c573 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023071175e95ccad074427b8c635425fdd8c573 2023-07-11 17:55:51,007 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/b38aa2a682bf930d63a6a27ffa681e2e/.tmp/family1/f5f42ddbde4d451688d8ad01675e1c85 2023-07-11 17:55:51,019 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/0500066ce9a917d77efcb830c43e6a63/.tmp/family1/050607db8d7b472d96e3750278616b19 2023-07-11 17:55:51,057 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202307112dcc186871b848b6adf48969c7b3e1b0 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b202307112dcc186871b848b6adf48969c7b3e1b0 2023-07-11 17:55:51,066 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202307115360383c1aee46acb866209f8d349b80 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c202307115360383c1aee46acb866209f8d349b80 2023-07-11 17:55:51,071 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/0500066ce9a917d77efcb830c43e6a63/.tmp/family2/f73a3c73a874488ab79ae9551ecb8df9 2023-07-11 17:55:51,074 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/0500066ce9a917d77efcb830c43e6a63/.tmp/family1/050607db8d7b472d96e3750278616b19 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/0500066ce9a917d77efcb830c43e6a63/family1/050607db8d7b472d96e3750278616b19 2023-07-11 17:55:51,101 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/0500066ce9a917d77efcb830c43e6a63/family1/050607db8d7b472d96e3750278616b19, entries=4, sequenceid=17, filesize=5.5 K 2023-07-11 17:55:51,102 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/0500066ce9a917d77efcb830c43e6a63/.tmp/family2/f73a3c73a874488ab79ae9551ecb8df9 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/0500066ce9a917d77efcb830c43e6a63/family2/f73a3c73a874488ab79ae9551ecb8df9 2023-07-11 17:55:51,105 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/0500066ce9a917d77efcb830c43e6a63/family2/f73a3c73a874488ab79ae9551ecb8df9, entries=2, sequenceid=17, filesize=5.1 K 2023-07-11 17:55:51,106 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 0500066ce9a917d77efcb830c43e6a63 in 584ms, sequenceid=17, compaction requested=true 2023-07-11 17:55:51,106 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 0500066ce9a917d77efcb830c43e6a63: 2023-07-11 17:55:51,106 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1689098143639.0500066ce9a917d77efcb830c43e6a63. 2023-07-11 17:55:51,106 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-07-11 17:55:51,419 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/810281b0ac113fdf6cb1bc56c9d6fbba/.tmp/family1/52a35b1964b44124978be5113d1f0b82 2023-07-11 17:55:51,463 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/b38aa2a682bf930d63a6a27ffa681e2e/.tmp/family2/e95faf42b17b468bb124461ad33a9956 2023-07-11 17:55:51,467 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/b38aa2a682bf930d63a6a27ffa681e2e/.tmp/family1/f5f42ddbde4d451688d8ad01675e1c85 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/b38aa2a682bf930d63a6a27ffa681e2e/family1/f5f42ddbde4d451688d8ad01675e1c85 2023-07-11 17:55:51,492 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/b38aa2a682bf930d63a6a27ffa681e2e/family1/f5f42ddbde4d451688d8ad01675e1c85, entries=4, sequenceid=17, filesize=5.5 K 2023-07-11 17:55:51,493 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/b38aa2a682bf930d63a6a27ffa681e2e/.tmp/family2/e95faf42b17b468bb124461ad33a9956 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/b38aa2a682bf930d63a6a27ffa681e2e/family2/e95faf42b17b468bb124461ad33a9956 2023-07-11 17:55:51,496 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/b38aa2a682bf930d63a6a27ffa681e2e/family2/e95faf42b17b468bb124461ad33a9956, entries=2, sequenceid=17, filesize=5.1 K 2023-07-11 17:55:51,497 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for b38aa2a682bf930d63a6a27ffa681e2e in 975ms, sequenceid=17, compaction requested=true 2023-07-11 17:55:51,497 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for b38aa2a682bf930d63a6a27ffa681e2e: 2023-07-11 17:55:51,497 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1689098143639.b38aa2a682bf930d63a6a27ffa681e2e. 2023-07-11 17:55:51,497 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-07-11 17:55:51,858 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307112862118b89e746c1a85500f2560e5f0d to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e202307112862118b89e746c1a85500f2560e5f0d 2023-07-11 17:55:52,263 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/810281b0ac113fdf6cb1bc56c9d6fbba/.tmp/family2/5eec2f044d964aeea17adcf724fff96b 2023-07-11 17:55:52,266 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/810281b0ac113fdf6cb1bc56c9d6fbba/.tmp/family1/52a35b1964b44124978be5113d1f0b82 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/810281b0ac113fdf6cb1bc56c9d6fbba/family1/52a35b1964b44124978be5113d1f0b82 2023-07-11 17:55:52,290 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/810281b0ac113fdf6cb1bc56c9d6fbba/family1/52a35b1964b44124978be5113d1f0b82, entries=4, sequenceid=17, filesize=5.5 K 2023-07-11 17:55:52,291 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/810281b0ac113fdf6cb1bc56c9d6fbba/.tmp/family2/5eec2f044d964aeea17adcf724fff96b as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/810281b0ac113fdf6cb1bc56c9d6fbba/family2/5eec2f044d964aeea17adcf724fff96b 2023-07-11 17:55:52,295 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/810281b0ac113fdf6cb1bc56c9d6fbba/family2/5eec2f044d964aeea17adcf724fff96b, entries=2, sequenceid=17, filesize=5.1 K 2023-07-11 17:55:52,296 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 810281b0ac113fdf6cb1bc56c9d6fbba in 1780ms, sequenceid=17, compaction requested=true 2023-07-11 17:55:52,296 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 810281b0ac113fdf6cb1bc56c9d6fbba: 2023-07-11 17:55:52,296 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1689098143639.810281b0ac113fdf6cb1bc56c9d6fbba. 2023-07-11 17:55:52,296 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-07-11 17:55:52,296 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-07-11 17:55:52,296 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:52,296 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-07-11 17:55:52,296 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-07-11 17:55:52,298 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:52,298 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-07-11 17:55:52,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:52,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:55:52,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:55:52,298 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-07-11 17:55:52,298 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 17:55:52,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:55:52,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:55:52,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-07-11 17:55:52,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:52,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:55:52,300 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-07-11 17:55:52,300 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7a11f8df[Count = 0] remaining members to acquire global barrier 2023-07-11 17:55:52,300 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-07-11 17:55:52,300 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-07-11 17:55:52,301 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-07-11 17:55:52,301 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-07-11 17:55:52,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-07-11 17:55:52,301 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-07-11 17:55:52,301 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-07-11 17:55:52,301 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase9.apache.org,45839,1689097999112' in zk 2023-07-11 17:55:52,301 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:52,301 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 17:55:52,302 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-07-11 17:55:52,302 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:52,302 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:55:52,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:52,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:55:52,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:55:52,303 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-07-11 17:55:52,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:55:52,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:55:52,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-07-11 17:55:52,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:52,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:55:52,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-07-11 17:55:52,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:52,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase9.apache.org,45839,1689097999112': 2023-07-11 17:55:52,305 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-07-11 17:55:52,305 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-07-11 17:55:52,305 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 17:55:52,305 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 17:55:52,305 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-07-11 17:55:52,305 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 17:55:52,307 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-07-11 17:55:52,307 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-07-11 17:55:52,307 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-07-11 17:55:52,307 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:55:52,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-07-11 17:55:52,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-07-11 17:55:52,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:55:52,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:55:52,308 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:55:52,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:55:52,308 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:52,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:55:52,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-07-11 17:55:52,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-07-11 17:55:52,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:55:52,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-07-11 17:55:52,309 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:52,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:52,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:55:52,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-07-11 17:55:52,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:52,311 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:52,311 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-07-11 17:55:52,311 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:55:52,311 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:55:52,311 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-07-11 17:55:52,311 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:55:52,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:55:52,311 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:52,311 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:55:52,311 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-07-11 17:55:52,311 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-07-11 17:55:52,311 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-07-11 17:55:52,311 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-07-11 17:55:52,311 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 17:55:52,311 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:55:52,312 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-07-11 17:55:52,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:55:52,312 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-07-11 17:55:52,312 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 17:55:52,412 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 17:55:52,413 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 17:55:52,427 DEBUG [Listener at localhost/43271] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-07-11 17:55:52,437 DEBUG [Listener at localhost/43271] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-07-11 17:55:52,448 DEBUG [Listener at localhost/43271] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-07-11 17:55:52,449 DEBUG [Listener at localhost/43271] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-07-11 17:55:52,559 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 17:55:52,561 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-07-11 17:55:52,561 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-07-11 17:55:52,561 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-07-11 17:55:52,561 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:55:52,561 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-07-11 17:55:52,561 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-07-11 17:55:52,561 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-07-11 17:55:52,561 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-07-11 17:55:52,562 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:55:52,562 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:52,563 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:55:52,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:55:52,563 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:52,563 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 17:55:52,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-07-11 17:55:52,563 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-07-11 17:55:52,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 17:55:52,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-07-11 17:55:52,563 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-07-11 17:55:52,564 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-07-11 17:55:52,564 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-07-11 17:55:52,564 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-07-11 17:55:52,564 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 17:55:52,564 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-07-11 17:55:52,564 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1689098143639.810281b0ac113fdf6cb1bc56c9d6fbba. 2023-07-11 17:55:52,564 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1689098143639.b38aa2a682bf930d63a6a27ffa681e2e. 2023-07-11 17:55:52,564 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-07-11 17:55:52,564 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1689098143639.b38aa2a682bf930d63a6a27ffa681e2e. started... 2023-07-11 17:55:52,564 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1689098143639.810281b0ac113fdf6cb1bc56c9d6fbba. started... 2023-07-11 17:55:52,564 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1689098143639.0500066ce9a917d77efcb830c43e6a63. 2023-07-11 17:55:52,564 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 810281b0ac113fdf6cb1bc56c9d6fbba 2/2 column families, dataSize=138 B heapSize=944 B 2023-07-11 17:55:52,564 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 17:55:52,564 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1689098143639.0500066ce9a917d77efcb830c43e6a63. started... 2023-07-11 17:55:52,564 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing b38aa2a682bf930d63a6a27ffa681e2e 2/2 column families, dataSize=138 B heapSize=944 B 2023-07-11 17:55:52,564 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 0500066ce9a917d77efcb830c43e6a63 2/2 column families, dataSize=138 B heapSize=944 B 2023-07-11 17:55:52,596 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/b38aa2a682bf930d63a6a27ffa681e2e/.tmp/family1/4b5ca84c378f4ac7a2009ce83504f8dc 2023-07-11 17:55:52,618 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4b5ca84c378f4ac7a2009ce83504f8dc 2023-07-11 17:55:52,629 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/b38aa2a682bf930d63a6a27ffa681e2e/.tmp/family2/af0693e75deb4dc1bcde1945b3d9189f 2023-07-11 17:55:52,632 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for af0693e75deb4dc1bcde1945b3d9189f 2023-07-11 17:55:52,633 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/b38aa2a682bf930d63a6a27ffa681e2e/.tmp/family1/4b5ca84c378f4ac7a2009ce83504f8dc as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/b38aa2a682bf930d63a6a27ffa681e2e/family1/4b5ca84c378f4ac7a2009ce83504f8dc 2023-07-11 17:55:52,657 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4b5ca84c378f4ac7a2009ce83504f8dc 2023-07-11 17:55:52,658 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/b38aa2a682bf930d63a6a27ffa681e2e/family1/4b5ca84c378f4ac7a2009ce83504f8dc, entries=3, sequenceid=23, filesize=5.2 K 2023-07-11 17:55:52,658 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/b38aa2a682bf930d63a6a27ffa681e2e/.tmp/family2/af0693e75deb4dc1bcde1945b3d9189f as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/b38aa2a682bf930d63a6a27ffa681e2e/family2/af0693e75deb4dc1bcde1945b3d9189f 2023-07-11 17:55:52,662 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for af0693e75deb4dc1bcde1945b3d9189f 2023-07-11 17:55:52,662 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/b38aa2a682bf930d63a6a27ffa681e2e/family2/af0693e75deb4dc1bcde1945b3d9189f, entries=1, sequenceid=23, filesize=5.0 K 2023-07-11 17:55:52,663 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for b38aa2a682bf930d63a6a27ffa681e2e in 99ms, sequenceid=23, compaction requested=true 2023-07-11 17:55:52,663 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for b38aa2a682bf930d63a6a27ffa681e2e: 2023-07-11 17:55:52,663 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1689098143639.b38aa2a682bf930d63a6a27ffa681e2e. 2023-07-11 17:55:52,663 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-07-11 17:55:53,030 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/0500066ce9a917d77efcb830c43e6a63/.tmp/family1/fa887b4bb5ae4a17b23b2c848c3dd58a 2023-07-11 17:55:53,079 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for fa887b4bb5ae4a17b23b2c848c3dd58a 2023-07-11 17:55:53,133 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/0500066ce9a917d77efcb830c43e6a63/.tmp/family2/ade25e000ee34b708c387df8929fa81b 2023-07-11 17:55:53,138 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ade25e000ee34b708c387df8929fa81b 2023-07-11 17:55:53,140 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/0500066ce9a917d77efcb830c43e6a63/.tmp/family1/fa887b4bb5ae4a17b23b2c848c3dd58a as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/0500066ce9a917d77efcb830c43e6a63/family1/fa887b4bb5ae4a17b23b2c848c3dd58a 2023-07-11 17:55:53,193 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for fa887b4bb5ae4a17b23b2c848c3dd58a 2023-07-11 17:55:53,193 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/0500066ce9a917d77efcb830c43e6a63/family1/fa887b4bb5ae4a17b23b2c848c3dd58a, entries=3, sequenceid=23, filesize=5.2 K 2023-07-11 17:55:53,194 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/0500066ce9a917d77efcb830c43e6a63/.tmp/family2/ade25e000ee34b708c387df8929fa81b as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/0500066ce9a917d77efcb830c43e6a63/family2/ade25e000ee34b708c387df8929fa81b 2023-07-11 17:55:53,204 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ade25e000ee34b708c387df8929fa81b 2023-07-11 17:55:53,204 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/0500066ce9a917d77efcb830c43e6a63/family2/ade25e000ee34b708c387df8929fa81b, entries=1, sequenceid=23, filesize=5.0 K 2023-07-11 17:55:53,205 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 0500066ce9a917d77efcb830c43e6a63 in 641ms, sequenceid=23, compaction requested=true 2023-07-11 17:55:53,205 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 0500066ce9a917d77efcb830c43e6a63: 2023-07-11 17:55:53,206 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1689098143639.0500066ce9a917d77efcb830c43e6a63. 2023-07-11 17:55:53,206 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-07-11 17:55:53,460 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/810281b0ac113fdf6cb1bc56c9d6fbba/.tmp/family1/3b7c6a6b171140cbbbe91b8ce247c13a 2023-07-11 17:55:53,501 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3b7c6a6b171140cbbbe91b8ce247c13a 2023-07-11 17:55:53,572 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/810281b0ac113fdf6cb1bc56c9d6fbba/.tmp/family2/c4dcd8c919974489aed5baeda74292b5 2023-07-11 17:55:53,578 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4dcd8c919974489aed5baeda74292b5 2023-07-11 17:55:53,579 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/810281b0ac113fdf6cb1bc56c9d6fbba/.tmp/family1/3b7c6a6b171140cbbbe91b8ce247c13a as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/810281b0ac113fdf6cb1bc56c9d6fbba/family1/3b7c6a6b171140cbbbe91b8ce247c13a 2023-07-11 17:55:53,621 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3b7c6a6b171140cbbbe91b8ce247c13a 2023-07-11 17:55:53,621 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/810281b0ac113fdf6cb1bc56c9d6fbba/family1/3b7c6a6b171140cbbbe91b8ce247c13a, entries=3, sequenceid=23, filesize=5.2 K 2023-07-11 17:55:53,622 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/810281b0ac113fdf6cb1bc56c9d6fbba/.tmp/family2/c4dcd8c919974489aed5baeda74292b5 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/810281b0ac113fdf6cb1bc56c9d6fbba/family2/c4dcd8c919974489aed5baeda74292b5 2023-07-11 17:55:53,628 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4dcd8c919974489aed5baeda74292b5 2023-07-11 17:55:53,628 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/810281b0ac113fdf6cb1bc56c9d6fbba/family2/c4dcd8c919974489aed5baeda74292b5, entries=1, sequenceid=23, filesize=5.0 K 2023-07-11 17:55:53,630 INFO [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 810281b0ac113fdf6cb1bc56c9d6fbba in 1066ms, sequenceid=23, compaction requested=true 2023-07-11 17:55:53,630 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 810281b0ac113fdf6cb1bc56c9d6fbba: 2023-07-11 17:55:53,630 DEBUG [rs(jenkins-hbase9.apache.org,45839,1689097999112)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1689098143639.810281b0ac113fdf6cb1bc56c9d6fbba. 2023-07-11 17:55:53,630 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-07-11 17:55:53,630 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-07-11 17:55:53,631 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:53,631 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-07-11 17:55:53,631 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-07-11 17:55:53,633 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-07-11 17:55:53,633 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:53,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:53,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:55:53,633 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-07-11 17:55:53,633 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 17:55:53,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:55:53,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:55:53,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:55:53,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-07-11 17:55:53,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:53,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:55:53,636 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45839,1689097999112' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-07-11 17:55:53,636 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2a04c456[Count = 0] remaining members to acquire global barrier 2023-07-11 17:55:53,636 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-07-11 17:55:53,636 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-07-11 17:55:53,639 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-07-11 17:55:53,639 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-07-11 17:55:53,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-07-11 17:55:53,639 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-07-11 17:55:53,639 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-07-11 17:55:53,639 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase9.apache.org,45839,1689097999112' in zk 2023-07-11 17:55:53,639 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:53,639 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 17:55:53,640 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-07-11 17:55:53,640 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:53,640 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:55:53,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:53,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:55:53,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:55:53,641 DEBUG [member: 'jenkins-hbase9.apache.org,45839,1689097999112' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-07-11 17:55:53,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:55:53,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:55:53,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-07-11 17:55:53,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:53,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:55:53,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-07-11 17:55:53,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:53,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase9.apache.org,45839,1689097999112': 2023-07-11 17:55:53,645 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45839,1689097999112' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-07-11 17:55:53,645 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-07-11 17:55:53,645 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 17:55:53,645 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 17:55:53,645 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-07-11 17:55:53,645 INFO [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 17:55:53,648 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-07-11 17:55:53,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-07-11 17:55:53,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 17:55:53,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 17:55:53,648 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-07-11 17:55:53,648 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:55:53,648 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-07-11 17:55:53,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-07-11 17:55:53,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 17:55:53,648 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:55:53,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:55:53,649 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:53,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-07-11 17:55:53,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-07-11 17:55:53,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 17:55:53,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-07-11 17:55:53,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:53,651 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:53,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 17:55:53,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-07-11 17:55:53,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:53,655 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 17:55:53,655 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 17:55:53,655 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:53,655 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-07-11 17:55:53,655 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-07-11 17:55:53,655 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:55:53,655 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-07-11 17:55:53,655 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 17:55:53,655 DEBUG [(jenkins-hbase9.apache.org,36885,1689097997830)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 17:55:53,655 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 17:55:53,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 17:55:53,655 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-07-11 17:55:53,656 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 17:55:53,655 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-07-11 17:55:53,656 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 17:55:53,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 17:55:53,655 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-07-11 17:55:53,656 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-07-11 17:55:53,656 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-07-11 17:55:53,756 DEBUG [Listener at localhost/43271] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 17:55:53,757 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36885] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 17:55:53,757 DEBUG [Listener at localhost/43271] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-07-11 17:55:53,757 DEBUG [Listener at localhost/43271] regionserver.HStore(1912): 810281b0ac113fdf6cb1bc56c9d6fbba/family1 is initiating major compaction (all files) 2023-07-11 17:55:53,758 INFO [Listener at localhost/43271] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-11 17:55:53,758 INFO [Listener at localhost/43271] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-11 17:55:53,758 INFO [Listener at localhost/43271] regionserver.HRegion(2259): Starting compaction of 810281b0ac113fdf6cb1bc56c9d6fbba/family1 in testMajorCompactionFromAdmin,,1689098143639.810281b0ac113fdf6cb1bc56c9d6fbba. 2023-07-11 17:55:53,758 INFO [Listener at localhost/43271] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/810281b0ac113fdf6cb1bc56c9d6fbba/family1/a08d0430401d490b8e5c2eeb0c3ab543, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/810281b0ac113fdf6cb1bc56c9d6fbba/family1/1cc4cea715994cabb11023a9d5a561f9, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/810281b0ac113fdf6cb1bc56c9d6fbba/family1/c86c3ab80f0646bf9c23a46ba43e5711, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/810281b0ac113fdf6cb1bc56c9d6fbba/family1/52a35b1964b44124978be5113d1f0b82, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/810281b0ac113fdf6cb1bc56c9d6fbba/family1/3b7c6a6b171140cbbbe91b8ce247c13a] into tmpdir=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/810281b0ac113fdf6cb1bc56c9d6fbba/.tmp, totalSize=27.1 K 2023-07-11 17:55:53,759 DEBUG [Listener at localhost/43271] compactions.Compactor(207): Compacting a08d0430401d490b8e5c2eeb0c3ab543, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1689098145839 2023-07-11 17:55:53,759 DEBUG [Listener at localhost/43271] compactions.Compactor(207): Compacting 1cc4cea715994cabb11023a9d5a561f9, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1689098147334 2023-07-11 17:55:53,760 DEBUG [Listener at localhost/43271] compactions.Compactor(207): Compacting c86c3ab80f0646bf9c23a46ba43e5711, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1689098149023 2023-07-11 17:55:53,761 DEBUG [Listener at localhost/43271] compactions.Compactor(207): Compacting 52a35b1964b44124978be5113d1f0b82, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1689098150505 2023-07-11 17:55:53,761 DEBUG [Listener at localhost/43271] compactions.Compactor(207): Compacting 3b7c6a6b171140cbbbe91b8ce247c13a, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-07-11 17:55:53,791 INFO [Listener at localhost/43271] throttle.PressureAwareThroughputController(145): 810281b0ac113fdf6cb1bc56c9d6fbba#family1#compaction#197 average throughput is 0.43 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-11 17:55:53,872 INFO [Listener at localhost/43271] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230711cfc26269779d44c2bf3dfb6e4381952e_del 2023-07-11 17:55:53,873 INFO [Listener at localhost/43271] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230711cfc26269779d44c2bf3dfb6e4381952e_del to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230711cfc26269779d44c2bf3dfb6e4381952e_del 2023-07-11 17:55:53,995 INFO [Listener at localhost/43271] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d193fe1da8b24e37b5d37fd4c349adc0 2023-07-11 17:55:53,995 DEBUG [Listener at localhost/43271] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/810281b0ac113fdf6cb1bc56c9d6fbba/.tmp/family1/d193fe1da8b24e37b5d37fd4c349adc0 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/810281b0ac113fdf6cb1bc56c9d6fbba/family1/d193fe1da8b24e37b5d37fd4c349adc0 2023-07-11 17:55:54,030 INFO [Listener at localhost/43271] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d193fe1da8b24e37b5d37fd4c349adc0 2023-07-11 17:55:54,031 INFO [Listener at localhost/43271] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 810281b0ac113fdf6cb1bc56c9d6fbba/family1 of 810281b0ac113fdf6cb1bc56c9d6fbba into d193fe1da8b24e37b5d37fd4c349adc0(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-11 17:55:54,032 DEBUG [Listener at localhost/43271] regionserver.HRegion(2289): Compaction status journal for 810281b0ac113fdf6cb1bc56c9d6fbba: 2023-07-11 17:55:54,032 DEBUG [Listener at localhost/43271] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-07-11 17:55:54,032 DEBUG [Listener at localhost/43271] regionserver.HStore(1912): 810281b0ac113fdf6cb1bc56c9d6fbba/family2 is initiating major compaction (all files) 2023-07-11 17:55:54,032 INFO [Listener at localhost/43271] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-11 17:55:54,032 INFO [Listener at localhost/43271] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-11 17:55:54,032 INFO [Listener at localhost/43271] regionserver.HRegion(2259): Starting compaction of 810281b0ac113fdf6cb1bc56c9d6fbba/family2 in testMajorCompactionFromAdmin,,1689098143639.810281b0ac113fdf6cb1bc56c9d6fbba. 2023-07-11 17:55:54,032 INFO [Listener at localhost/43271] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/810281b0ac113fdf6cb1bc56c9d6fbba/family2/3a83a367730c4267a13afc47f735cd08, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/810281b0ac113fdf6cb1bc56c9d6fbba/family2/2b1182b12a794ea79a8a889f285c7c09, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/810281b0ac113fdf6cb1bc56c9d6fbba/family2/bf59dc8ac8c54785b0d3ba9505cfad3a, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/810281b0ac113fdf6cb1bc56c9d6fbba/family2/5eec2f044d964aeea17adcf724fff96b, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/810281b0ac113fdf6cb1bc56c9d6fbba/family2/c4dcd8c919974489aed5baeda74292b5] into tmpdir=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/810281b0ac113fdf6cb1bc56c9d6fbba/.tmp, totalSize=25.4 K 2023-07-11 17:55:54,033 DEBUG [Listener at localhost/43271] compactions.Compactor(207): Compacting 3a83a367730c4267a13afc47f735cd08, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1689098145839 2023-07-11 17:55:54,034 DEBUG [Listener at localhost/43271] compactions.Compactor(207): Compacting 2b1182b12a794ea79a8a889f285c7c09, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1689098147334 2023-07-11 17:55:54,035 DEBUG [Listener at localhost/43271] compactions.Compactor(207): Compacting bf59dc8ac8c54785b0d3ba9505cfad3a, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1689098149023 2023-07-11 17:55:54,037 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/810281b0ac113fdf6cb1bc56c9d6fbba/family1/a08d0430401d490b8e5c2eeb0c3ab543, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/810281b0ac113fdf6cb1bc56c9d6fbba/family1/1cc4cea715994cabb11023a9d5a561f9, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/810281b0ac113fdf6cb1bc56c9d6fbba/family1/c86c3ab80f0646bf9c23a46ba43e5711, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/810281b0ac113fdf6cb1bc56c9d6fbba/family1/52a35b1964b44124978be5113d1f0b82, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/810281b0ac113fdf6cb1bc56c9d6fbba/family1/3b7c6a6b171140cbbbe91b8ce247c13a] to archive 2023-07-11 17:55:54,038 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 17:55:54,038 DEBUG [Listener at localhost/43271] compactions.Compactor(207): Compacting 5eec2f044d964aeea17adcf724fff96b, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1689098150505 2023-07-11 17:55:54,038 DEBUG [Listener at localhost/43271] compactions.Compactor(207): Compacting c4dcd8c919974489aed5baeda74292b5, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-07-11 17:55:54,040 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/810281b0ac113fdf6cb1bc56c9d6fbba/family1/a08d0430401d490b8e5c2eeb0c3ab543 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionFromAdmin/810281b0ac113fdf6cb1bc56c9d6fbba/family1/a08d0430401d490b8e5c2eeb0c3ab543 2023-07-11 17:55:54,041 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/810281b0ac113fdf6cb1bc56c9d6fbba/family1/1cc4cea715994cabb11023a9d5a561f9 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionFromAdmin/810281b0ac113fdf6cb1bc56c9d6fbba/family1/1cc4cea715994cabb11023a9d5a561f9 2023-07-11 17:55:54,044 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/810281b0ac113fdf6cb1bc56c9d6fbba/family1/c86c3ab80f0646bf9c23a46ba43e5711 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionFromAdmin/810281b0ac113fdf6cb1bc56c9d6fbba/family1/c86c3ab80f0646bf9c23a46ba43e5711 2023-07-11 17:55:54,045 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/810281b0ac113fdf6cb1bc56c9d6fbba/family1/52a35b1964b44124978be5113d1f0b82 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionFromAdmin/810281b0ac113fdf6cb1bc56c9d6fbba/family1/52a35b1964b44124978be5113d1f0b82 2023-07-11 17:55:54,048 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/810281b0ac113fdf6cb1bc56c9d6fbba/family1/3b7c6a6b171140cbbbe91b8ce247c13a to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionFromAdmin/810281b0ac113fdf6cb1bc56c9d6fbba/family1/3b7c6a6b171140cbbbe91b8ce247c13a 2023-07-11 17:55:54,097 INFO [Listener at localhost/43271] throttle.PressureAwareThroughputController(145): 810281b0ac113fdf6cb1bc56c9d6fbba#family2#compaction#198 average throughput is 0.03 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-11 17:55:54,128 INFO [Listener at localhost/43271] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230711982a91f8beb2444bba3182c20b19368f_del 2023-07-11 17:55:54,129 INFO [Listener at localhost/43271] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230711982a91f8beb2444bba3182c20b19368f_del to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20230711982a91f8beb2444bba3182c20b19368f_del 2023-07-11 17:55:54,215 INFO [Listener at localhost/43271] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4c05b83451d54daa904c4341a5a8b769 2023-07-11 17:55:54,218 DEBUG [Listener at localhost/43271] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/810281b0ac113fdf6cb1bc56c9d6fbba/.tmp/family2/4c05b83451d54daa904c4341a5a8b769 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/810281b0ac113fdf6cb1bc56c9d6fbba/family2/4c05b83451d54daa904c4341a5a8b769 2023-07-11 17:55:54,225 INFO [Listener at localhost/43271] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4c05b83451d54daa904c4341a5a8b769 2023-07-11 17:55:54,226 INFO [Listener at localhost/43271] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 810281b0ac113fdf6cb1bc56c9d6fbba/family2 of 810281b0ac113fdf6cb1bc56c9d6fbba into 4c05b83451d54daa904c4341a5a8b769(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-11 17:55:54,226 DEBUG [Listener at localhost/43271] regionserver.HRegion(2289): Compaction status journal for 810281b0ac113fdf6cb1bc56c9d6fbba: 2023-07-11 17:55:54,227 DEBUG [Listener at localhost/43271] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-07-11 17:55:54,227 DEBUG [Listener at localhost/43271] regionserver.HStore(1912): b38aa2a682bf930d63a6a27ffa681e2e/family1 is initiating major compaction (all files) 2023-07-11 17:55:54,227 INFO [Listener at localhost/43271] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-11 17:55:54,228 INFO [Listener at localhost/43271] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-11 17:55:54,230 INFO [Listener at localhost/43271] regionserver.HRegion(2259): Starting compaction of b38aa2a682bf930d63a6a27ffa681e2e/family1 in testMajorCompactionFromAdmin,1,1689098143639.b38aa2a682bf930d63a6a27ffa681e2e. 2023-07-11 17:55:54,230 INFO [Listener at localhost/43271] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/b38aa2a682bf930d63a6a27ffa681e2e/family1/469149fe29954bf08202a88335c53fd5, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/b38aa2a682bf930d63a6a27ffa681e2e/family1/0a54681d47e641b991e7ebc8a9836244, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/b38aa2a682bf930d63a6a27ffa681e2e/family1/a432a79563bb4abe98100c67f4f6bc72, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/b38aa2a682bf930d63a6a27ffa681e2e/family1/f5f42ddbde4d451688d8ad01675e1c85, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/b38aa2a682bf930d63a6a27ffa681e2e/family1/4b5ca84c378f4ac7a2009ce83504f8dc] into tmpdir=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/b38aa2a682bf930d63a6a27ffa681e2e/.tmp, totalSize=27.1 K 2023-07-11 17:55:54,231 DEBUG [Listener at localhost/43271] compactions.Compactor(207): Compacting 469149fe29954bf08202a88335c53fd5, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1689098145840 2023-07-11 17:55:54,231 DEBUG [Listener at localhost/43271] compactions.Compactor(207): Compacting 0a54681d47e641b991e7ebc8a9836244, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1689098147335 2023-07-11 17:55:54,232 DEBUG [Listener at localhost/43271] compactions.Compactor(207): Compacting a432a79563bb4abe98100c67f4f6bc72, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1689098149024 2023-07-11 17:55:54,232 DEBUG [Listener at localhost/43271] compactions.Compactor(207): Compacting f5f42ddbde4d451688d8ad01675e1c85, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1689098150505 2023-07-11 17:55:54,233 DEBUG [Listener at localhost/43271] compactions.Compactor(207): Compacting 4b5ca84c378f4ac7a2009ce83504f8dc, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-07-11 17:55:54,237 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/810281b0ac113fdf6cb1bc56c9d6fbba/family2/3a83a367730c4267a13afc47f735cd08, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/810281b0ac113fdf6cb1bc56c9d6fbba/family2/2b1182b12a794ea79a8a889f285c7c09, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/810281b0ac113fdf6cb1bc56c9d6fbba/family2/bf59dc8ac8c54785b0d3ba9505cfad3a, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/810281b0ac113fdf6cb1bc56c9d6fbba/family2/5eec2f044d964aeea17adcf724fff96b, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/810281b0ac113fdf6cb1bc56c9d6fbba/family2/c4dcd8c919974489aed5baeda74292b5] to archive 2023-07-11 17:55:54,237 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 17:55:54,240 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/810281b0ac113fdf6cb1bc56c9d6fbba/family2/3a83a367730c4267a13afc47f735cd08 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionFromAdmin/810281b0ac113fdf6cb1bc56c9d6fbba/family2/3a83a367730c4267a13afc47f735cd08 2023-07-11 17:55:54,242 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/810281b0ac113fdf6cb1bc56c9d6fbba/family2/2b1182b12a794ea79a8a889f285c7c09 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionFromAdmin/810281b0ac113fdf6cb1bc56c9d6fbba/family2/2b1182b12a794ea79a8a889f285c7c09 2023-07-11 17:55:54,244 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/810281b0ac113fdf6cb1bc56c9d6fbba/family2/bf59dc8ac8c54785b0d3ba9505cfad3a to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionFromAdmin/810281b0ac113fdf6cb1bc56c9d6fbba/family2/bf59dc8ac8c54785b0d3ba9505cfad3a 2023-07-11 17:55:54,246 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/810281b0ac113fdf6cb1bc56c9d6fbba/family2/5eec2f044d964aeea17adcf724fff96b to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionFromAdmin/810281b0ac113fdf6cb1bc56c9d6fbba/family2/5eec2f044d964aeea17adcf724fff96b 2023-07-11 17:55:54,247 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/810281b0ac113fdf6cb1bc56c9d6fbba/family2/c4dcd8c919974489aed5baeda74292b5 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionFromAdmin/810281b0ac113fdf6cb1bc56c9d6fbba/family2/c4dcd8c919974489aed5baeda74292b5 2023-07-11 17:55:54,260 INFO [Listener at localhost/43271] throttle.PressureAwareThroughputController(145): b38aa2a682bf930d63a6a27ffa681e2e#family1#compaction#199 average throughput is 0.57 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-11 17:55:54,770 INFO [Listener at localhost/43271] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202307116668ae4e12724de8b09178087b71e8ef_del 2023-07-11 17:55:54,771 INFO [Listener at localhost/43271] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202307116668ae4e12724de8b09178087b71e8ef_del to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202307116668ae4e12724de8b09178087b71e8ef_del 2023-07-11 17:55:55,676 INFO [Listener at localhost/43271] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ab2928b353824ef580afbad0f677d647 2023-07-11 17:55:55,676 DEBUG [Listener at localhost/43271] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/b38aa2a682bf930d63a6a27ffa681e2e/.tmp/family1/ab2928b353824ef580afbad0f677d647 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/b38aa2a682bf930d63a6a27ffa681e2e/family1/ab2928b353824ef580afbad0f677d647 2023-07-11 17:55:55,698 INFO [Listener at localhost/43271] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ab2928b353824ef580afbad0f677d647 2023-07-11 17:55:55,699 INFO [Listener at localhost/43271] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in b38aa2a682bf930d63a6a27ffa681e2e/family1 of b38aa2a682bf930d63a6a27ffa681e2e into ab2928b353824ef580afbad0f677d647(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-07-11 17:55:55,700 DEBUG [Listener at localhost/43271] regionserver.HRegion(2289): Compaction status journal for b38aa2a682bf930d63a6a27ffa681e2e: 2023-07-11 17:55:55,700 DEBUG [Listener at localhost/43271] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-07-11 17:55:55,700 DEBUG [Listener at localhost/43271] regionserver.HStore(1912): b38aa2a682bf930d63a6a27ffa681e2e/family2 is initiating major compaction (all files) 2023-07-11 17:55:55,700 INFO [Listener at localhost/43271] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-11 17:55:55,700 INFO [Listener at localhost/43271] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-11 17:55:55,700 INFO [Listener at localhost/43271] regionserver.HRegion(2259): Starting compaction of b38aa2a682bf930d63a6a27ffa681e2e/family2 in testMajorCompactionFromAdmin,1,1689098143639.b38aa2a682bf930d63a6a27ffa681e2e. 2023-07-11 17:55:55,700 INFO [Listener at localhost/43271] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/b38aa2a682bf930d63a6a27ffa681e2e/family2/4f8322a6816a43ff87c8edabcd21f9cb, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/b38aa2a682bf930d63a6a27ffa681e2e/family2/76f927abfd8f452e932d3cc8bd37e6af, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/b38aa2a682bf930d63a6a27ffa681e2e/family2/e682ff1c9fd8448180db103ab501927a, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/b38aa2a682bf930d63a6a27ffa681e2e/family2/e95faf42b17b468bb124461ad33a9956, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/b38aa2a682bf930d63a6a27ffa681e2e/family2/af0693e75deb4dc1bcde1945b3d9189f] into tmpdir=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/b38aa2a682bf930d63a6a27ffa681e2e/.tmp, totalSize=25.4 K 2023-07-11 17:55:55,701 DEBUG [Listener at localhost/43271] compactions.Compactor(207): Compacting 4f8322a6816a43ff87c8edabcd21f9cb, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1689098145840 2023-07-11 17:55:55,701 DEBUG [Listener at localhost/43271] compactions.Compactor(207): Compacting 76f927abfd8f452e932d3cc8bd37e6af, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1689098147335 2023-07-11 17:55:55,702 DEBUG [Listener at localhost/43271] compactions.Compactor(207): Compacting e682ff1c9fd8448180db103ab501927a, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1689098149024 2023-07-11 17:55:55,702 DEBUG [Listener at localhost/43271] compactions.Compactor(207): Compacting e95faf42b17b468bb124461ad33a9956, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1689098150505 2023-07-11 17:55:55,702 DEBUG [Listener at localhost/43271] compactions.Compactor(207): Compacting af0693e75deb4dc1bcde1945b3d9189f, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-07-11 17:55:55,709 INFO [Listener at localhost/43271] throttle.PressureAwareThroughputController(145): b38aa2a682bf930d63a6a27ffa681e2e#family2#compaction#200 average throughput is 1.06 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-11 17:55:55,737 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/b38aa2a682bf930d63a6a27ffa681e2e/family1/469149fe29954bf08202a88335c53fd5, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/b38aa2a682bf930d63a6a27ffa681e2e/family1/0a54681d47e641b991e7ebc8a9836244, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/b38aa2a682bf930d63a6a27ffa681e2e/family1/a432a79563bb4abe98100c67f4f6bc72, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/b38aa2a682bf930d63a6a27ffa681e2e/family1/f5f42ddbde4d451688d8ad01675e1c85, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/b38aa2a682bf930d63a6a27ffa681e2e/family1/4b5ca84c378f4ac7a2009ce83504f8dc] to archive 2023-07-11 17:55:55,738 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 17:55:55,741 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/b38aa2a682bf930d63a6a27ffa681e2e/family1/469149fe29954bf08202a88335c53fd5 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionFromAdmin/b38aa2a682bf930d63a6a27ffa681e2e/family1/469149fe29954bf08202a88335c53fd5 2023-07-11 17:55:55,742 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/b38aa2a682bf930d63a6a27ffa681e2e/family1/0a54681d47e641b991e7ebc8a9836244 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionFromAdmin/b38aa2a682bf930d63a6a27ffa681e2e/family1/0a54681d47e641b991e7ebc8a9836244 2023-07-11 17:55:55,743 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/b38aa2a682bf930d63a6a27ffa681e2e/family1/a432a79563bb4abe98100c67f4f6bc72 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionFromAdmin/b38aa2a682bf930d63a6a27ffa681e2e/family1/a432a79563bb4abe98100c67f4f6bc72 2023-07-11 17:55:55,744 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/b38aa2a682bf930d63a6a27ffa681e2e/family1/f5f42ddbde4d451688d8ad01675e1c85 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionFromAdmin/b38aa2a682bf930d63a6a27ffa681e2e/family1/f5f42ddbde4d451688d8ad01675e1c85 2023-07-11 17:55:55,745 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/b38aa2a682bf930d63a6a27ffa681e2e/family1/4b5ca84c378f4ac7a2009ce83504f8dc to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionFromAdmin/b38aa2a682bf930d63a6a27ffa681e2e/family1/4b5ca84c378f4ac7a2009ce83504f8dc 2023-07-11 17:55:56,116 INFO [Listener at localhost/43271] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202307114bc8d625328a4138b6edd3de808306b1_del 2023-07-11 17:55:56,117 INFO [Listener at localhost/43271] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202307114bc8d625328a4138b6edd3de808306b1_del to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b202307114bc8d625328a4138b6edd3de808306b1_del 2023-07-11 17:55:56,929 INFO [Listener at localhost/43271] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2fd5a9bba80b48c5a8cd885c80cec2e8 2023-07-11 17:55:56,930 DEBUG [Listener at localhost/43271] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/b38aa2a682bf930d63a6a27ffa681e2e/.tmp/family2/2fd5a9bba80b48c5a8cd885c80cec2e8 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/b38aa2a682bf930d63a6a27ffa681e2e/family2/2fd5a9bba80b48c5a8cd885c80cec2e8 2023-07-11 17:55:56,935 INFO [Listener at localhost/43271] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2fd5a9bba80b48c5a8cd885c80cec2e8 2023-07-11 17:55:56,936 INFO [Listener at localhost/43271] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in b38aa2a682bf930d63a6a27ffa681e2e/family2 of b38aa2a682bf930d63a6a27ffa681e2e into 2fd5a9bba80b48c5a8cd885c80cec2e8(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-07-11 17:55:56,936 DEBUG [Listener at localhost/43271] regionserver.HRegion(2289): Compaction status journal for b38aa2a682bf930d63a6a27ffa681e2e: 2023-07-11 17:55:56,936 DEBUG [Listener at localhost/43271] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-07-11 17:55:56,936 DEBUG [Listener at localhost/43271] regionserver.HStore(1912): 0500066ce9a917d77efcb830c43e6a63/family1 is initiating major compaction (all files) 2023-07-11 17:55:56,936 INFO [Listener at localhost/43271] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-11 17:55:56,936 INFO [Listener at localhost/43271] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-11 17:55:56,936 INFO [Listener at localhost/43271] regionserver.HRegion(2259): Starting compaction of 0500066ce9a917d77efcb830c43e6a63/family1 in testMajorCompactionFromAdmin,2,1689098143639.0500066ce9a917d77efcb830c43e6a63. 2023-07-11 17:55:56,937 INFO [Listener at localhost/43271] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/0500066ce9a917d77efcb830c43e6a63/family1/df8dc251c1264b729ad2d9318a72dfd9, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/0500066ce9a917d77efcb830c43e6a63/family1/6e0c7f87b10a4942ab1ecf9fae2397bd, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/0500066ce9a917d77efcb830c43e6a63/family1/3c0ca99687ff4f44a76882b5ceb7fe4b, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/0500066ce9a917d77efcb830c43e6a63/family1/050607db8d7b472d96e3750278616b19, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/0500066ce9a917d77efcb830c43e6a63/family1/fa887b4bb5ae4a17b23b2c848c3dd58a] into tmpdir=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/0500066ce9a917d77efcb830c43e6a63/.tmp, totalSize=27.1 K 2023-07-11 17:55:56,937 DEBUG [Listener at localhost/43271] compactions.Compactor(207): Compacting df8dc251c1264b729ad2d9318a72dfd9, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1689098145840 2023-07-11 17:55:56,937 DEBUG [Listener at localhost/43271] compactions.Compactor(207): Compacting 6e0c7f87b10a4942ab1ecf9fae2397bd, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1689098147335 2023-07-11 17:55:56,938 DEBUG [Listener at localhost/43271] compactions.Compactor(207): Compacting 3c0ca99687ff4f44a76882b5ceb7fe4b, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1689098149024 2023-07-11 17:55:56,938 DEBUG [Listener at localhost/43271] compactions.Compactor(207): Compacting 050607db8d7b472d96e3750278616b19, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1689098150506 2023-07-11 17:55:56,938 DEBUG [Listener at localhost/43271] compactions.Compactor(207): Compacting fa887b4bb5ae4a17b23b2c848c3dd58a, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-07-11 17:55:56,939 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/b38aa2a682bf930d63a6a27ffa681e2e/family2/4f8322a6816a43ff87c8edabcd21f9cb, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/b38aa2a682bf930d63a6a27ffa681e2e/family2/76f927abfd8f452e932d3cc8bd37e6af, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/b38aa2a682bf930d63a6a27ffa681e2e/family2/e682ff1c9fd8448180db103ab501927a, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/b38aa2a682bf930d63a6a27ffa681e2e/family2/e95faf42b17b468bb124461ad33a9956, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/b38aa2a682bf930d63a6a27ffa681e2e/family2/af0693e75deb4dc1bcde1945b3d9189f] to archive 2023-07-11 17:55:56,941 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 17:55:56,942 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/b38aa2a682bf930d63a6a27ffa681e2e/family2/4f8322a6816a43ff87c8edabcd21f9cb to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionFromAdmin/b38aa2a682bf930d63a6a27ffa681e2e/family2/4f8322a6816a43ff87c8edabcd21f9cb 2023-07-11 17:55:56,944 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/b38aa2a682bf930d63a6a27ffa681e2e/family2/76f927abfd8f452e932d3cc8bd37e6af to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionFromAdmin/b38aa2a682bf930d63a6a27ffa681e2e/family2/76f927abfd8f452e932d3cc8bd37e6af 2023-07-11 17:55:56,945 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/b38aa2a682bf930d63a6a27ffa681e2e/family2/e682ff1c9fd8448180db103ab501927a to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionFromAdmin/b38aa2a682bf930d63a6a27ffa681e2e/family2/e682ff1c9fd8448180db103ab501927a 2023-07-11 17:55:56,946 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/b38aa2a682bf930d63a6a27ffa681e2e/family2/e95faf42b17b468bb124461ad33a9956 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionFromAdmin/b38aa2a682bf930d63a6a27ffa681e2e/family2/e95faf42b17b468bb124461ad33a9956 2023-07-11 17:55:56,947 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/b38aa2a682bf930d63a6a27ffa681e2e/family2/af0693e75deb4dc1bcde1945b3d9189f to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionFromAdmin/b38aa2a682bf930d63a6a27ffa681e2e/family2/af0693e75deb4dc1bcde1945b3d9189f 2023-07-11 17:55:56,950 INFO [Listener at localhost/43271] throttle.PressureAwareThroughputController(145): 0500066ce9a917d77efcb830c43e6a63#family1#compaction#201 average throughput is 0.86 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-11 17:55:57,388 INFO [Listener at localhost/43271] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20230711464375f4aa5848029272bb1059528a7e_del 2023-07-11 17:55:57,388 INFO [Listener at localhost/43271] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230711464375f4aa5848029272bb1059528a7e_del to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230711464375f4aa5848029272bb1059528a7e_del 2023-07-11 17:55:57,855 INFO [Listener at localhost/43271] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 878c64ab74714a7187c5dffc8c4b748f 2023-07-11 17:55:57,856 DEBUG [Listener at localhost/43271] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/0500066ce9a917d77efcb830c43e6a63/.tmp/family1/878c64ab74714a7187c5dffc8c4b748f as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/0500066ce9a917d77efcb830c43e6a63/family1/878c64ab74714a7187c5dffc8c4b748f 2023-07-11 17:55:57,891 INFO [Listener at localhost/43271] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 878c64ab74714a7187c5dffc8c4b748f 2023-07-11 17:55:57,892 INFO [Listener at localhost/43271] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 0500066ce9a917d77efcb830c43e6a63/family1 of 0500066ce9a917d77efcb830c43e6a63 into 878c64ab74714a7187c5dffc8c4b748f(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-11 17:55:57,892 DEBUG [Listener at localhost/43271] regionserver.HRegion(2289): Compaction status journal for 0500066ce9a917d77efcb830c43e6a63: 2023-07-11 17:55:57,892 DEBUG [Listener at localhost/43271] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-07-11 17:55:57,892 DEBUG [Listener at localhost/43271] regionserver.HStore(1912): 0500066ce9a917d77efcb830c43e6a63/family2 is initiating major compaction (all files) 2023-07-11 17:55:57,893 INFO [Listener at localhost/43271] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-11 17:55:57,893 INFO [Listener at localhost/43271] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-11 17:55:57,893 INFO [Listener at localhost/43271] regionserver.HRegion(2259): Starting compaction of 0500066ce9a917d77efcb830c43e6a63/family2 in testMajorCompactionFromAdmin,2,1689098143639.0500066ce9a917d77efcb830c43e6a63. 2023-07-11 17:55:57,893 INFO [Listener at localhost/43271] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/0500066ce9a917d77efcb830c43e6a63/family2/26dfbe695db94da3b0c3454a7e2078e6, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/0500066ce9a917d77efcb830c43e6a63/family2/0898f7ab37654fbe8f59c41a8de31766, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/0500066ce9a917d77efcb830c43e6a63/family2/e09b6d21bf37488c961dc2388b223557, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/0500066ce9a917d77efcb830c43e6a63/family2/f73a3c73a874488ab79ae9551ecb8df9, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/0500066ce9a917d77efcb830c43e6a63/family2/ade25e000ee34b708c387df8929fa81b] into tmpdir=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/0500066ce9a917d77efcb830c43e6a63/.tmp, totalSize=25.4 K 2023-07-11 17:55:57,893 DEBUG [Listener at localhost/43271] compactions.Compactor(207): Compacting 26dfbe695db94da3b0c3454a7e2078e6, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1689098145840 2023-07-11 17:55:57,894 DEBUG [Listener at localhost/43271] compactions.Compactor(207): Compacting 0898f7ab37654fbe8f59c41a8de31766, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1689098147335 2023-07-11 17:55:57,894 DEBUG [Listener at localhost/43271] compactions.Compactor(207): Compacting e09b6d21bf37488c961dc2388b223557, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1689098149024 2023-07-11 17:55:57,895 DEBUG [Listener at localhost/43271] compactions.Compactor(207): Compacting f73a3c73a874488ab79ae9551ecb8df9, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1689098150506 2023-07-11 17:55:57,895 DEBUG [Listener at localhost/43271] compactions.Compactor(207): Compacting ade25e000ee34b708c387df8929fa81b, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-07-11 17:55:57,904 INFO [Listener at localhost/43271] throttle.PressureAwareThroughputController(145): 0500066ce9a917d77efcb830c43e6a63#family2#compaction#202 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-11 17:55:57,937 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/0500066ce9a917d77efcb830c43e6a63/family1/df8dc251c1264b729ad2d9318a72dfd9, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/0500066ce9a917d77efcb830c43e6a63/family1/6e0c7f87b10a4942ab1ecf9fae2397bd, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/0500066ce9a917d77efcb830c43e6a63/family1/3c0ca99687ff4f44a76882b5ceb7fe4b, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/0500066ce9a917d77efcb830c43e6a63/family1/050607db8d7b472d96e3750278616b19, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/0500066ce9a917d77efcb830c43e6a63/family1/fa887b4bb5ae4a17b23b2c848c3dd58a] to archive 2023-07-11 17:55:57,938 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 17:55:57,939 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/0500066ce9a917d77efcb830c43e6a63/family1/df8dc251c1264b729ad2d9318a72dfd9 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionFromAdmin/0500066ce9a917d77efcb830c43e6a63/family1/df8dc251c1264b729ad2d9318a72dfd9 2023-07-11 17:55:57,940 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/0500066ce9a917d77efcb830c43e6a63/family1/6e0c7f87b10a4942ab1ecf9fae2397bd to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionFromAdmin/0500066ce9a917d77efcb830c43e6a63/family1/6e0c7f87b10a4942ab1ecf9fae2397bd 2023-07-11 17:55:57,942 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/0500066ce9a917d77efcb830c43e6a63/family1/3c0ca99687ff4f44a76882b5ceb7fe4b to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionFromAdmin/0500066ce9a917d77efcb830c43e6a63/family1/3c0ca99687ff4f44a76882b5ceb7fe4b 2023-07-11 17:55:57,943 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/0500066ce9a917d77efcb830c43e6a63/family1/050607db8d7b472d96e3750278616b19 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionFromAdmin/0500066ce9a917d77efcb830c43e6a63/family1/050607db8d7b472d96e3750278616b19 2023-07-11 17:55:57,944 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/0500066ce9a917d77efcb830c43e6a63/family1/fa887b4bb5ae4a17b23b2c848c3dd58a to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionFromAdmin/0500066ce9a917d77efcb830c43e6a63/family1/fa887b4bb5ae4a17b23b2c848c3dd58a 2023-07-11 17:55:58,319 INFO [Listener at localhost/43271] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20230711c9e206e8579443818851aa3cfc48c29a_del 2023-07-11 17:55:58,319 INFO [Listener at localhost/43271] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230711c9e206e8579443818851aa3cfc48c29a_del to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20230711c9e206e8579443818851aa3cfc48c29a_del 2023-07-11 17:55:58,331 INFO [Listener at localhost/43271] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for eeac1e3ef7764f5fbe389d14b81a0670 2023-07-11 17:55:58,332 DEBUG [Listener at localhost/43271] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/0500066ce9a917d77efcb830c43e6a63/.tmp/family2/eeac1e3ef7764f5fbe389d14b81a0670 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/0500066ce9a917d77efcb830c43e6a63/family2/eeac1e3ef7764f5fbe389d14b81a0670 2023-07-11 17:55:58,336 INFO [Listener at localhost/43271] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for eeac1e3ef7764f5fbe389d14b81a0670 2023-07-11 17:55:58,337 INFO [Listener at localhost/43271] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 0500066ce9a917d77efcb830c43e6a63/family2 of 0500066ce9a917d77efcb830c43e6a63 into eeac1e3ef7764f5fbe389d14b81a0670(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-11 17:55:58,337 DEBUG [Listener at localhost/43271] regionserver.HRegion(2289): Compaction status journal for 0500066ce9a917d77efcb830c43e6a63: 2023-07-11 17:55:58,340 DEBUG [Listener at localhost/43271] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-07-11 17:55:58,342 DEBUG [Listener at localhost/43271] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-07-11 17:55:58,343 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/0500066ce9a917d77efcb830c43e6a63/family2/26dfbe695db94da3b0c3454a7e2078e6, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/0500066ce9a917d77efcb830c43e6a63/family2/0898f7ab37654fbe8f59c41a8de31766, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/0500066ce9a917d77efcb830c43e6a63/family2/e09b6d21bf37488c961dc2388b223557, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/0500066ce9a917d77efcb830c43e6a63/family2/f73a3c73a874488ab79ae9551ecb8df9, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/0500066ce9a917d77efcb830c43e6a63/family2/ade25e000ee34b708c387df8929fa81b] to archive 2023-07-11 17:55:58,343 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 17:55:58,345 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/0500066ce9a917d77efcb830c43e6a63/family2/26dfbe695db94da3b0c3454a7e2078e6 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionFromAdmin/0500066ce9a917d77efcb830c43e6a63/family2/26dfbe695db94da3b0c3454a7e2078e6 2023-07-11 17:55:58,346 DEBUG [Listener at localhost/43271] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-07-11 17:55:58,346 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/0500066ce9a917d77efcb830c43e6a63/family2/0898f7ab37654fbe8f59c41a8de31766 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionFromAdmin/0500066ce9a917d77efcb830c43e6a63/family2/0898f7ab37654fbe8f59c41a8de31766 2023-07-11 17:55:58,347 DEBUG [Listener at localhost/43271] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-07-11 17:55:58,348 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/0500066ce9a917d77efcb830c43e6a63/family2/e09b6d21bf37488c961dc2388b223557 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionFromAdmin/0500066ce9a917d77efcb830c43e6a63/family2/e09b6d21bf37488c961dc2388b223557 2023-07-11 17:55:58,349 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/0500066ce9a917d77efcb830c43e6a63/family2/f73a3c73a874488ab79ae9551ecb8df9 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionFromAdmin/0500066ce9a917d77efcb830c43e6a63/family2/f73a3c73a874488ab79ae9551ecb8df9 2023-07-11 17:55:58,351 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/0500066ce9a917d77efcb830c43e6a63/family2/ade25e000ee34b708c387df8929fa81b to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionFromAdmin/0500066ce9a917d77efcb830c43e6a63/family2/ade25e000ee34b708c387df8929fa81b 2023-07-11 17:55:58,353 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=36885] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10"1\xDC\xFE&\xAE2\x19}\xC475/O6V"\x10\x9C\xF4\x95&\xCDgK\xCAK\x8F_c\x8A\xBDeM*\x10#\xFD\xE1\xC5\x8E;B\xCA\xEC\xF8\xA8{~\xB1\xEA\xD32\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testMajorCompactionFromAdmin 2023-07-11 17:55:58,375 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] procedure2.ProcedureExecutor(1029): Stored pid=123, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-07-11 17:55:58,376 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=123, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-07-11 17:55:58,377 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionFromAdmin', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-07-11 17:55:58,377 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=123, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1689098758377 2023-07-11 17:55:58,377 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-07-11 17:55:58,542 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-11 17:55:58,542 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7a2ea0de to 127.0.0.1:50702 2023-07-11 17:55:58,542 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 17:55:58,754 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 3 del files, 12 selected files, and 0 irrelevant files table 'testMajorCompactionFromAdmin' and column 'family1' 2023-07-11 17:55:58,775 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230711cfc26269779d44c2bf3dfb6e4381952e_del 2023-07-11 17:55:58,796 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202307116668ae4e12724de8b09178087b71e8ef_del 2023-07-11 17:55:58,820 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20230711464375f4aa5848029272bb1059528a7e_del 2023-07-11 17:55:58,820 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='testMajorCompactionFromAdmin' column='family1' 2023-07-11 17:55:58,820 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] zookeeper.ReadOnlyZKClient(139): Connect 0x08bcae55 to 127.0.0.1:50702 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 17:55:58,830 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1a077bd0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 17:55:58,830 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230711 for table='testMajorCompactionFromAdmin' and column='family1' 2023-07-11 17:55:59,791 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307116e6a6f3b7e9b4d1085378739216591f8 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202307116e6a6f3b7e9b4d1085378739216591f8 2023-07-11 17:55:59,792 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230711 table='testMajorCompactionFromAdmin' column='family1' 2023-07-11 17:55:59,803 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 17:55:59,805 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:60450, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 17:55:59,813 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-11 17:55:59,815 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:45174, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-11 17:55:59,843 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230711/family1/ee944c9959f340d3828313223e55bb50 first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x07] 2023-07-11 17:55:59,843 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionFromAdmin,,1689098143639.810281b0ac113fdf6cb1bc56c9d6fbba., hostname=jenkins-hbase9.apache.org,45839,1689097999112, seqNum=2 for row with hfile group [{family1,hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230711/family1/ee944c9959f340d3828313223e55bb50}] 2023-07-11 17:55:59,848 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(763): Validating hfile at hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230711/family1/ee944c9959f340d3828313223e55bb50 for inclusion in 810281b0ac113fdf6cb1bc56c9d6fbba/family1 2023-07-11 17:55:59,869 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x07 2023-07-11 17:55:59,869 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(777): Region bounds: first= last=1 2023-07-11 17:55:59,869 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HRegion(2446): Flush status journal for 810281b0ac113fdf6cb1bc56c9d6fbba: 2023-07-11 17:55:59,870 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230711/family1/ee944c9959f340d3828313223e55bb50 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testMajorCompactionFromAdmin__udga1ju8avqs0tl01k4sslpnql0d8mbilghpgveo27q1vnk0rt6fe4qh3838j3b7/family1/ee944c9959f340d3828313223e55bb50 2023-07-11 17:55:59,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testMajorCompactionFromAdmin__udga1ju8avqs0tl01k4sslpnql0d8mbilghpgveo27q1vnk0rt6fe4qh3838j3b7/family1/ee944c9959f340d3828313223e55bb50 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/810281b0ac113fdf6cb1bc56c9d6fbba/family1/787a3b8ae2c14e0da9d0c61ff78bf3ac_SeqId_28_ 2023-07-11 17:55:59,872 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(849): Loaded HFile hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testMajorCompactionFromAdmin__udga1ju8avqs0tl01k4sslpnql0d8mbilghpgveo27q1vnk0rt6fe4qh3838j3b7/family1/ee944c9959f340d3828313223e55bb50 into 810281b0ac113fdf6cb1bc56c9d6fbba/family1 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/810281b0ac113fdf6cb1bc56c9d6fbba/family1/787a3b8ae2c14e0da9d0c61ff78bf3ac_SeqId_28_ - updating store file list. 2023-07-11 17:55:59,893 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(882): Loaded HFile hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/810281b0ac113fdf6cb1bc56c9d6fbba/family1/787a3b8ae2c14e0da9d0c61ff78bf3ac_SeqId_28_ into 810281b0ac113fdf6cb1bc56c9d6fbba/family1 2023-07-11 17:55:59,893 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(855): Successfully loaded hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testMajorCompactionFromAdmin__udga1ju8avqs0tl01k4sslpnql0d8mbilghpgveo27q1vnk0rt6fe4qh3838j3b7/family1/ee944c9959f340d3828313223e55bb50 into 810281b0ac113fdf6cb1bc56c9d6fbba/family1 (new location: hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/810281b0ac113fdf6cb1bc56c9d6fbba/family1/787a3b8ae2c14e0da9d0c61ff78bf3ac_SeqId_28_) 2023-07-11 17:55:59,894 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testMajorCompactionFromAdmin__udga1ju8avqs0tl01k4sslpnql0d8mbilghpgveo27q1vnk0rt6fe4qh3838j3b7/family1/ee944c9959f340d3828313223e55bb50 2023-07-11 17:55:59,896 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230711 table='testMajorCompactionFromAdmin' column='family1' 2023-07-11 17:55:59,896 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 17:55:59,898 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202307110c24d70506a74a949c849880ba77dd21 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202307110c24d70506a74a949c849880ba77dd21 2023-07-11 17:55:59,898 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202307112945e21be35a413eb196d6891e0da185 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202307112945e21be35a413eb196d6891e0da185 2023-07-11 17:55:59,899 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023071175e95ccad074427b8c635425fdd8c573 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023071175e95ccad074427b8c635425fdd8c573 2023-07-11 17:55:59,900 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230711c7a15a652d37413b9ddb7f103356d8c6 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230711c7a15a652d37413b9ddb7f103356d8c6 2023-07-11 17:55:59,900 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-07-11 17:55:59,900 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230711' 2023-07-11 17:55:59,900 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230711 for table='testMajorCompactionFromAdmin' and column='family1' 2023-07-11 17:55:59,900 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230711 for table='testMajorCompactionFromAdmin' and column='family1' 2023-07-11 17:56:00,570 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230711fce7f545fd7e4144a93c55fc35a8e218 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230711fce7f545fd7e4144a93c55fc35a8e218 2023-07-11 17:56:00,571 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230711 table='testMajorCompactionFromAdmin' column='family1' 2023-07-11 17:56:00,625 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230711/family1/28c9c26c35c5439fbc6f5e6ed58a86db first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x07] 2023-07-11 17:56:00,626 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionFromAdmin,2,1689098143639.0500066ce9a917d77efcb830c43e6a63., hostname=jenkins-hbase9.apache.org,45839,1689097999112, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230711/family1/28c9c26c35c5439fbc6f5e6ed58a86db}] 2023-07-11 17:56:00,628 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(763): Validating hfile at hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230711/family1/28c9c26c35c5439fbc6f5e6ed58a86db for inclusion in 0500066ce9a917d77efcb830c43e6a63/family1 2023-07-11 17:56:00,659 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x07 2023-07-11 17:56:00,659 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(777): Region bounds: first=2 last= 2023-07-11 17:56:00,659 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HRegion(2446): Flush status journal for 0500066ce9a917d77efcb830c43e6a63: 2023-07-11 17:56:00,660 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230711/family1/28c9c26c35c5439fbc6f5e6ed58a86db to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testMajorCompactionFromAdmin__9eilpkc5flub187ivkm2h00uhofcsu4d83rgpp2a6o0iutlhq93ve3rvbmdgj083/family1/28c9c26c35c5439fbc6f5e6ed58a86db 2023-07-11 17:56:00,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testMajorCompactionFromAdmin__9eilpkc5flub187ivkm2h00uhofcsu4d83rgpp2a6o0iutlhq93ve3rvbmdgj083/family1/28c9c26c35c5439fbc6f5e6ed58a86db as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/0500066ce9a917d77efcb830c43e6a63/family1/22f73ebb32ba4fe2807739d10f1fee80_SeqId_28_ 2023-07-11 17:56:00,662 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(849): Loaded HFile hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testMajorCompactionFromAdmin__9eilpkc5flub187ivkm2h00uhofcsu4d83rgpp2a6o0iutlhq93ve3rvbmdgj083/family1/28c9c26c35c5439fbc6f5e6ed58a86db into 0500066ce9a917d77efcb830c43e6a63/family1 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/0500066ce9a917d77efcb830c43e6a63/family1/22f73ebb32ba4fe2807739d10f1fee80_SeqId_28_ - updating store file list. 2023-07-11 17:56:00,690 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(882): Loaded HFile hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/0500066ce9a917d77efcb830c43e6a63/family1/22f73ebb32ba4fe2807739d10f1fee80_SeqId_28_ into 0500066ce9a917d77efcb830c43e6a63/family1 2023-07-11 17:56:00,690 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(855): Successfully loaded hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testMajorCompactionFromAdmin__9eilpkc5flub187ivkm2h00uhofcsu4d83rgpp2a6o0iutlhq93ve3rvbmdgj083/family1/28c9c26c35c5439fbc6f5e6ed58a86db into 0500066ce9a917d77efcb830c43e6a63/family1 (new location: hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/0500066ce9a917d77efcb830c43e6a63/family1/22f73ebb32ba4fe2807739d10f1fee80_SeqId_28_) 2023-07-11 17:56:00,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testMajorCompactionFromAdmin__9eilpkc5flub187ivkm2h00uhofcsu4d83rgpp2a6o0iutlhq93ve3rvbmdgj083/family1/28c9c26c35c5439fbc6f5e6ed58a86db 2023-07-11 17:56:00,692 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230711 table='testMajorCompactionFromAdmin' column='family1' 2023-07-11 17:56:00,693 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 17:56:00,694 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202307112c8377c1ec9d418f82857ae6af82e65c to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202307112c8377c1ec9d418f82857ae6af82e65c 2023-07-11 17:56:00,695 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202307114fcd2ca1b0f14e11bf27cf7b468c85a1 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202307114fcd2ca1b0f14e11bf27cf7b468c85a1 2023-07-11 17:56:00,696 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202307118445fbfeb9e74bd1af390f18fc2db17c to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202307118445fbfeb9e74bd1af390f18fc2db17c 2023-07-11 17:56:00,697 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230711bfb03745089248fa9d903c823ecedd2c to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230711bfb03745089248fa9d903c823ecedd2c 2023-07-11 17:56:00,697 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-07-11 17:56:00,697 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230711' 2023-07-11 17:56:00,697 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230711 for table='testMajorCompactionFromAdmin' and column='family1' 2023-07-11 17:56:00,697 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20230711 for table='testMajorCompactionFromAdmin' and column='family1' 2023-07-11 17:56:01,645 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230711012a108909094712ae14cfc2dbbbc586 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230711012a108909094712ae14cfc2dbbbc586 2023-07-11 17:56:01,646 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230711 table='testMajorCompactionFromAdmin' column='family1' 2023-07-11 17:56:01,687 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230711/family1/e6b91b31d6924c519da15e4847762900 first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x07] 2023-07-11 17:56:01,688 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionFromAdmin,1,1689098143639.b38aa2a682bf930d63a6a27ffa681e2e., hostname=jenkins-hbase9.apache.org,45839,1689097999112, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230711/family1/e6b91b31d6924c519da15e4847762900}] 2023-07-11 17:56:01,690 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(763): Validating hfile at hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230711/family1/e6b91b31d6924c519da15e4847762900 for inclusion in b38aa2a682bf930d63a6a27ffa681e2e/family1 2023-07-11 17:56:01,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x07 2023-07-11 17:56:01,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(777): Region bounds: first=1 last=2 2023-07-11 17:56:01,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HRegion(2446): Flush status journal for b38aa2a682bf930d63a6a27ffa681e2e: 2023-07-11 17:56:01,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230711/family1/e6b91b31d6924c519da15e4847762900 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testMajorCompactionFromAdmin__mf51gesrqjll0fatchtqon2r9vrr882neg8mfkv6djuj1d5kstlm2fu0ak3i6rgi/family1/e6b91b31d6924c519da15e4847762900 2023-07-11 17:56:01,714 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testMajorCompactionFromAdmin__mf51gesrqjll0fatchtqon2r9vrr882neg8mfkv6djuj1d5kstlm2fu0ak3i6rgi/family1/e6b91b31d6924c519da15e4847762900 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/b38aa2a682bf930d63a6a27ffa681e2e/family1/052e53e3ea59440fb26190e0de62db84_SeqId_28_ 2023-07-11 17:56:01,714 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(849): Loaded HFile hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testMajorCompactionFromAdmin__mf51gesrqjll0fatchtqon2r9vrr882neg8mfkv6djuj1d5kstlm2fu0ak3i6rgi/family1/e6b91b31d6924c519da15e4847762900 into b38aa2a682bf930d63a6a27ffa681e2e/family1 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/b38aa2a682bf930d63a6a27ffa681e2e/family1/052e53e3ea59440fb26190e0de62db84_SeqId_28_ - updating store file list. 2023-07-11 17:56:01,736 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(882): Loaded HFile hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/b38aa2a682bf930d63a6a27ffa681e2e/family1/052e53e3ea59440fb26190e0de62db84_SeqId_28_ into b38aa2a682bf930d63a6a27ffa681e2e/family1 2023-07-11 17:56:01,736 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.HStore(855): Successfully loaded hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testMajorCompactionFromAdmin__mf51gesrqjll0fatchtqon2r9vrr882neg8mfkv6djuj1d5kstlm2fu0ak3i6rgi/family1/e6b91b31d6924c519da15e4847762900 into b38aa2a682bf930d63a6a27ffa681e2e/family1 (new location: hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/b38aa2a682bf930d63a6a27ffa681e2e/family1/052e53e3ea59440fb26190e0de62db84_SeqId_28_) 2023-07-11 17:56:01,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45839] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/staging/jenkins__testMajorCompactionFromAdmin__mf51gesrqjll0fatchtqon2r9vrr882neg8mfkv6djuj1d5kstlm2fu0ak3i6rgi/family1/e6b91b31d6924c519da15e4847762900 2023-07-11 17:56:01,738 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230711 table='testMajorCompactionFromAdmin' column='family1' 2023-07-11 17:56:01,739 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 17:56:01,740 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230711061fb63ad8e34e1d876c39b69dda0372 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230711061fb63ad8e34e1d876c39b69dda0372 2023-07-11 17:56:01,741 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202307110798dff452924f9dbd32a2740a837c38 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202307110798dff452924f9dbd32a2740a837c38 2023-07-11 17:56:01,742 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230711394adb95ee5f4fb995a063f7bc1b8f3f to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230711394adb95ee5f4fb995a063f7bc1b8f3f 2023-07-11 17:56:01,742 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230711b1d0db3a5ac3462cb8bec951e0fc88b2 to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230711b1d0db3a5ac3462cb8bec951e0fc88b2 2023-07-11 17:56:01,743 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-07-11 17:56:01,743 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230711' 2023-07-11 17:56:01,743 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20230711 for table='testMajorCompactionFromAdmin' and column='family1' 2023-07-11 17:56:01,743 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testMajorCompactionFromAdmin' column='family1' 2023-07-11 17:56:01,743 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] compactions.PartitionedMobCompactor(364): After a mob compaction with all files selected, archiving the del files for table='testMajorCompactionFromAdmin' and column='family1' 2023-07-11 17:56:01,743 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] compactions.PartitionedMobCompactor(367): [hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230711cfc26269779d44c2bf3dfb6e4381952e_del] 2023-07-11 17:56:01,743 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 17:56:01,744 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230711cfc26269779d44c2bf3dfb6e4381952e_del to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230711cfc26269779d44c2bf3dfb6e4381952e_del 2023-07-11 17:56:01,744 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-07-11 17:56:01,745 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] compactions.PartitionedMobCompactor(367): [hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202307116668ae4e12724de8b09178087b71e8ef_del] 2023-07-11 17:56:01,745 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 17:56:01,746 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202307116668ae4e12724de8b09178087b71e8ef_del to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202307116668ae4e12724de8b09178087b71e8ef_del 2023-07-11 17:56:01,746 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-07-11 17:56:01,746 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] compactions.PartitionedMobCompactor(367): [hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230711464375f4aa5848029272bb1059528a7e_del] 2023-07-11 17:56:01,746 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 17:56:01,747 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230711464375f4aa5848029272bb1059528a7e_del to hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230711464375f4aa5848029272bb1059528a7e_del 2023-07-11 17:56:01,747 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-07-11 17:56:01,747 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1689098002013] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionFromAdmin', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-07-11 17:56:01,748 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=123, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-07-11 17:56:01,749 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=123, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE in 3.3730 sec 2023-07-11 17:56:01,762 DEBUG [Listener at localhost/43271] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-07-11 17:56:01,764 DEBUG [Listener at localhost/43271] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-07-11 17:56:01,767 DEBUG [Listener at localhost/43271] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-07-11 17:56:01,767 DEBUG [Listener at localhost/43271] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-07-11 17:56:01,771 INFO [Listener at localhost/43271] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 17:56:01,807 INFO [Listener at localhost/43271] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionFromAdmin Thread=251 (was 261), OpenFileDescriptor=647 (was 649), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=334 (was 266) - SystemLoadAverage LEAK? -, ProcessCount=169 (was 170), AvailableMemoryMB=8016 (was 8619) 2023-07-11 17:56:01,807 DEBUG [Listener at localhost/43271] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x57816685 to 127.0.0.1:50702 2023-07-11 17:56:01,807 DEBUG [Listener at localhost/43271] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 17:56:01,808 INFO [Listener at localhost/43271] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-11 17:56:01,808 INFO [Listener at localhost/43271] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-11 17:56:01,808 DEBUG [Listener at localhost/43271] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1480d1ce to 127.0.0.1:50702 2023-07-11 17:56:01,808 DEBUG [Listener at localhost/43271] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 17:56:01,808 DEBUG [Listener at localhost/43271] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-11 17:56:01,808 DEBUG [Listener at localhost/43271] util.JVMClusterUtil(257): Found active master hash=619720735, stopped=false 2023-07-11 17:56:01,809 INFO [Listener at localhost/43271] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase9.apache.org,36885,1689097997830 2023-07-11 17:56:01,812 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-11 17:56:01,812 INFO [Listener at localhost/43271] procedure2.ProcedureExecutor(629): Stopping 2023-07-11 17:56:01,812 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-11 17:56:01,812 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 17:56:01,812 DEBUG [Listener at localhost/43271] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x08f07289 to 127.0.0.1:50702 2023-07-11 17:56:01,812 DEBUG [Listener at localhost/43271] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 17:56:01,812 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-11 17:56:01,812 INFO [Listener at localhost/43271] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase9.apache.org,45839,1689097999112' ***** 2023-07-11 17:56:01,812 INFO [Listener at localhost/43271] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-11 17:56:01,812 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-11 17:56:01,813 INFO [RS:0;jenkins-hbase9:45839] regionserver.HeapMemoryManager(220): Stopping 2023-07-11 17:56:01,813 INFO [RS:0;jenkins-hbase9:45839] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-11 17:56:01,813 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-11 17:56:01,813 INFO [RS:0;jenkins-hbase9:45839] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-11 17:56:01,813 INFO [RS:0;jenkins-hbase9:45839] regionserver.HRegionServer(3305): Received CLOSE for 86ac0fab4b9c1edad19043fde0c2391a 2023-07-11 17:56:01,813 INFO [RS:0;jenkins-hbase9:45839] regionserver.HRegionServer(3305): Received CLOSE for 810281b0ac113fdf6cb1bc56c9d6fbba 2023-07-11 17:56:01,813 INFO [RS:0;jenkins-hbase9:45839] regionserver.HRegionServer(3305): Received CLOSE for b38aa2a682bf930d63a6a27ffa681e2e 2023-07-11 17:56:01,813 INFO [RS:0;jenkins-hbase9:45839] regionserver.HRegionServer(3305): Received CLOSE for fcc1e02fb516934639a517c1444369be 2023-07-11 17:56:01,813 INFO [RS:0;jenkins-hbase9:45839] regionserver.HRegionServer(3305): Received CLOSE for e3f02074d49896da91a4a986ed5a3926 2023-07-11 17:56:01,813 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 86ac0fab4b9c1edad19043fde0c2391a, disabling compactions & flushes 2023-07-11 17:56:01,814 INFO [RS:0;jenkins-hbase9:45839] regionserver.HRegionServer(3305): Received CLOSE for 4e4357287b129f0600b33397cb2004ec 2023-07-11 17:56:01,814 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyPolicy,,1689098047452.86ac0fab4b9c1edad19043fde0c2391a. 2023-07-11 17:56:01,814 INFO [RS:0;jenkins-hbase9:45839] regionserver.HRegionServer(3305): Received CLOSE for 797d03d17f9b32921e56ea87bcf5ae5e 2023-07-11 17:56:01,814 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyPolicy,,1689098047452.86ac0fab4b9c1edad19043fde0c2391a. 2023-07-11 17:56:01,814 INFO [RS:0;jenkins-hbase9:45839] regionserver.HRegionServer(3305): Received CLOSE for 47ee8c355f31465b357785487e314b0f 2023-07-11 17:56:01,814 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyPolicy,,1689098047452.86ac0fab4b9c1edad19043fde0c2391a. after waiting 0 ms 2023-07-11 17:56:01,814 INFO [RS:0;jenkins-hbase9:45839] regionserver.HRegionServer(3305): Received CLOSE for 03ba78e07b3026a36a7cde3865422d82 2023-07-11 17:56:01,814 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyPolicy,,1689098047452.86ac0fab4b9c1edad19043fde0c2391a. 2023-07-11 17:56:01,814 INFO [RS:0;jenkins-hbase9:45839] regionserver.HRegionServer(3305): Received CLOSE for 32200e46ee32133355d305b07aa3b428 2023-07-11 17:56:01,814 INFO [RS:0;jenkins-hbase9:45839] regionserver.HRegionServer(3305): Received CLOSE for c81222d442c0705212f76de2b50cf141 2023-07-11 17:56:01,814 INFO [RS:0;jenkins-hbase9:45839] regionserver.HRegionServer(3305): Received CLOSE for 0500066ce9a917d77efcb830c43e6a63 2023-07-11 17:56:01,814 INFO [RS:0;jenkins-hbase9:45839] regionserver.HRegionServer(3305): Received CLOSE for 17aacf583da279539e944e5353cb4f95 2023-07-11 17:56:01,814 INFO [RS:0;jenkins-hbase9:45839] regionserver.HRegionServer(3305): Received CLOSE for 8c00c428ffdb4840522b5e5a88c37ff1 2023-07-11 17:56:01,814 INFO [RS:0;jenkins-hbase9:45839] regionserver.HRegionServer(3305): Received CLOSE for dada713f65e06525f8aa63e933747743 2023-07-11 17:56:01,814 INFO [RS:0;jenkins-hbase9:45839] regionserver.HRegionServer(3305): Received CLOSE for c13bb432df8709c95734bd08b015997b 2023-07-11 17:56:01,814 INFO [RS:0;jenkins-hbase9:45839] regionserver.HRegionServer(3305): Received CLOSE for 55b22085c6b006e3a631c2a366691bf8 2023-07-11 17:56:01,814 INFO [RS:0;jenkins-hbase9:45839] regionserver.HRegionServer(3305): Received CLOSE for 79dd09a662e99a3de62daf35d6a0df12 2023-07-11 17:56:01,814 INFO [RS:0;jenkins-hbase9:45839] regionserver.HRegionServer(3305): Received CLOSE for 64a1f72c6487e7f4ae550729b9dbcb83 2023-07-11 17:56:01,814 INFO [RS:0;jenkins-hbase9:45839] regionserver.HRegionServer(3305): Received CLOSE for 0b68e8a6a3555cdd10a16d0303c35da7 2023-07-11 17:56:01,814 INFO [RS:0;jenkins-hbase9:45839] regionserver.HRegionServer(1144): stopping server jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:56:01,814 DEBUG [RS:0;jenkins-hbase9:45839] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0fa7039a to 127.0.0.1:50702 2023-07-11 17:56:01,814 DEBUG [RS:0;jenkins-hbase9:45839] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 17:56:01,815 INFO [RS:0;jenkins-hbase9:45839] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-11 17:56:01,815 INFO [RS:0;jenkins-hbase9:45839] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-11 17:56:01,815 INFO [RS:0;jenkins-hbase9:45839] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-11 17:56:01,815 INFO [RS:0;jenkins-hbase9:45839] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-11 17:56:01,815 INFO [RS:0;jenkins-hbase9:45839] regionserver.HRegionServer(1474): Waiting on 21 regions to close 2023-07-11 17:56:01,815 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-11 17:56:01,815 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-11 17:56:01,815 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-11 17:56:01,815 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-11 17:56:01,815 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-11 17:56:01,816 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=50.56 KB heapSize=78.23 KB 2023-07-11 17:56:01,816 DEBUG [RS:0;jenkins-hbase9:45839] regionserver.HRegionServer(1504): Waiting on 03ba78e07b3026a36a7cde3865422d82, 0500066ce9a917d77efcb830c43e6a63, 0b68e8a6a3555cdd10a16d0303c35da7, 1588230740, 17aacf583da279539e944e5353cb4f95, 32200e46ee32133355d305b07aa3b428, 47ee8c355f31465b357785487e314b0f, 4e4357287b129f0600b33397cb2004ec, 55b22085c6b006e3a631c2a366691bf8, 64a1f72c6487e7f4ae550729b9dbcb83, 797d03d17f9b32921e56ea87bcf5ae5e, 79dd09a662e99a3de62daf35d6a0df12, 810281b0ac113fdf6cb1bc56c9d6fbba, 86ac0fab4b9c1edad19043fde0c2391a, 8c00c428ffdb4840522b5e5a88c37ff1, b38aa2a682bf930d63a6a27ffa681e2e, c13bb432df8709c95734bd08b015997b, c81222d442c0705212f76de2b50cf141, dada713f65e06525f8aa63e933747743, e3f02074d49896da91a4a986ed5a3926, fcc1e02fb516934639a517c1444369be 2023-07-11 17:56:01,817 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyPolicy/86ac0fab4b9c1edad19043fde0c2391a/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-07-11 17:56:01,818 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyPolicy,,1689098047452.86ac0fab4b9c1edad19043fde0c2391a. 2023-07-11 17:56:01,818 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 86ac0fab4b9c1edad19043fde0c2391a: 2023-07-11 17:56:01,819 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyPolicy,,1689098047452.86ac0fab4b9c1edad19043fde0c2391a. 2023-07-11 17:56:01,819 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 810281b0ac113fdf6cb1bc56c9d6fbba, disabling compactions & flushes 2023-07-11 17:56:01,819 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,,1689098143639.810281b0ac113fdf6cb1bc56c9d6fbba. 2023-07-11 17:56:01,819 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,,1689098143639.810281b0ac113fdf6cb1bc56c9d6fbba. 2023-07-11 17:56:01,819 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,,1689098143639.810281b0ac113fdf6cb1bc56c9d6fbba. after waiting 0 ms 2023-07-11 17:56:01,819 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,,1689098143639.810281b0ac113fdf6cb1bc56c9d6fbba. 2023-07-11 17:56:01,823 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/810281b0ac113fdf6cb1bc56c9d6fbba/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-07-11 17:56:01,824 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,,1689098143639.810281b0ac113fdf6cb1bc56c9d6fbba. 2023-07-11 17:56:01,824 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 810281b0ac113fdf6cb1bc56c9d6fbba: 2023-07-11 17:56:01,824 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,,1689098143639.810281b0ac113fdf6cb1bc56c9d6fbba. 2023-07-11 17:56:01,824 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing b38aa2a682bf930d63a6a27ffa681e2e, disabling compactions & flushes 2023-07-11 17:56:01,824 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,1,1689098143639.b38aa2a682bf930d63a6a27ffa681e2e. 2023-07-11 17:56:01,824 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,1,1689098143639.b38aa2a682bf930d63a6a27ffa681e2e. 2023-07-11 17:56:01,824 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,1,1689098143639.b38aa2a682bf930d63a6a27ffa681e2e. after waiting 0 ms 2023-07-11 17:56:01,824 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,1,1689098143639.b38aa2a682bf930d63a6a27ffa681e2e. 2023-07-11 17:56:01,825 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=48.28 KB at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/hbase/meta/1588230740/.tmp/info/9eaa4059a73e487e9682249cce7c56b3 2023-07-11 17:56:01,828 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/b38aa2a682bf930d63a6a27ffa681e2e/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-07-11 17:56:01,829 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,1,1689098143639.b38aa2a682bf930d63a6a27ffa681e2e. 2023-07-11 17:56:01,829 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for b38aa2a682bf930d63a6a27ffa681e2e: 2023-07-11 17:56:01,829 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,1,1689098143639.b38aa2a682bf930d63a6a27ffa681e2e. 2023-07-11 17:56:01,829 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing fcc1e02fb516934639a517c1444369be, disabling compactions & flushes 2023-07-11 17:56:01,829 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithWeeklyPolicy,,1689098029447.fcc1e02fb516934639a517c1444369be. 2023-07-11 17:56:01,829 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithWeeklyPolicy,,1689098029447.fcc1e02fb516934639a517c1444369be. 2023-07-11 17:56:01,829 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithWeeklyPolicy,,1689098029447.fcc1e02fb516934639a517c1444369be. after waiting 0 ms 2023-07-11 17:56:01,829 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithWeeklyPolicy,,1689098029447.fcc1e02fb516934639a517c1444369be. 2023-07-11 17:56:01,830 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9eaa4059a73e487e9682249cce7c56b3 2023-07-11 17:56:01,832 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithWeeklyPolicy/fcc1e02fb516934639a517c1444369be/recovered.edits/49.seqid, newMaxSeqId=49, maxSeqId=1 2023-07-11 17:56:01,833 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testMinorCompactionWithWeeklyPolicy,,1689098029447.fcc1e02fb516934639a517c1444369be. 2023-07-11 17:56:01,833 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for fcc1e02fb516934639a517c1444369be: 2023-07-11 17:56:01,833 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed testMinorCompactionWithWeeklyPolicy,,1689098029447.fcc1e02fb516934639a517c1444369be. 2023-07-11 17:56:01,833 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing e3f02074d49896da91a4a986ed5a3926, disabling compactions & flushes 2023-07-11 17:56:01,833 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1689098002155.e3f02074d49896da91a4a986ed5a3926. 2023-07-11 17:56:01,833 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1689098002155.e3f02074d49896da91a4a986ed5a3926. 2023-07-11 17:56:01,833 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1689098002155.e3f02074d49896da91a4a986ed5a3926. after waiting 0 ms 2023-07-11 17:56:01,833 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1689098002155.e3f02074d49896da91a4a986ed5a3926. 2023-07-11 17:56:01,836 INFO [regionserver/jenkins-hbase9:0.Chore.2] hbase.ScheduledChore(146): Chore: CompactedHFilesCleaner was stopped 2023-07-11 17:56:01,836 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e3f02074d49896da91a4a986ed5a3926/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=49 2023-07-11 17:56:01,836 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1689098002155.e3f02074d49896da91a4a986ed5a3926. 2023-07-11 17:56:01,836 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for e3f02074d49896da91a4a986ed5a3926: 2023-07-11 17:56:01,836 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1689098002155.e3f02074d49896da91a4a986ed5a3926. 2023-07-11 17:56:01,837 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 4e4357287b129f0600b33397cb2004ec, disabling compactions & flushes 2023-07-11 17:56:01,837 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,1,1689098116506.4e4357287b129f0600b33397cb2004ec. 2023-07-11 17:56:01,837 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,1,1689098116506.4e4357287b129f0600b33397cb2004ec. 2023-07-11 17:56:01,837 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,1,1689098116506.4e4357287b129f0600b33397cb2004ec. after waiting 0 ms 2023-07-11 17:56:01,837 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,1,1689098116506.4e4357287b129f0600b33397cb2004ec. 2023-07-11 17:56:01,839 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/4e4357287b129f0600b33397cb2004ec/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-07-11 17:56:01,840 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,1,1689098116506.4e4357287b129f0600b33397cb2004ec. 2023-07-11 17:56:01,840 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 4e4357287b129f0600b33397cb2004ec: 2023-07-11 17:56:01,840 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,1,1689098116506.4e4357287b129f0600b33397cb2004ec. 2023-07-11 17:56:01,840 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 797d03d17f9b32921e56ea87bcf5ae5e, disabling compactions & flushes 2023-07-11 17:56:01,840 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithMonthlyPolicy,,1689098134208.797d03d17f9b32921e56ea87bcf5ae5e. 2023-07-11 17:56:01,840 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithMonthlyPolicy,,1689098134208.797d03d17f9b32921e56ea87bcf5ae5e. 2023-07-11 17:56:01,840 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithMonthlyPolicy,,1689098134208.797d03d17f9b32921e56ea87bcf5ae5e. after waiting 0 ms 2023-07-11 17:56:01,840 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithMonthlyPolicy,,1689098134208.797d03d17f9b32921e56ea87bcf5ae5e. 2023-07-11 17:56:01,843 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMinorCompactionWithMonthlyPolicy/797d03d17f9b32921e56ea87bcf5ae5e/recovered.edits/52.seqid, newMaxSeqId=52, maxSeqId=1 2023-07-11 17:56:01,844 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testMinorCompactionWithMonthlyPolicy,,1689098134208.797d03d17f9b32921e56ea87bcf5ae5e. 2023-07-11 17:56:01,844 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 797d03d17f9b32921e56ea87bcf5ae5e: 2023-07-11 17:56:01,844 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed testMinorCompactionWithMonthlyPolicy,,1689098134208.797d03d17f9b32921e56ea87bcf5ae5e. 2023-07-11 17:56:01,844 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 47ee8c355f31465b357785487e314b0f, disabling compactions & flushes 2023-07-11 17:56:01,844 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,2,1689098042452.47ee8c355f31465b357785487e314b0f. 2023-07-11 17:56:01,844 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,2,1689098042452.47ee8c355f31465b357785487e314b0f. 2023-07-11 17:56:01,844 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,2,1689098042452.47ee8c355f31465b357785487e314b0f. after waiting 0 ms 2023-07-11 17:56:01,844 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,2,1689098042452.47ee8c355f31465b357785487e314b0f. 2023-07-11 17:56:01,846 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testScannerOnBulkLoadRefHFiles/47ee8c355f31465b357785487e314b0f/recovered.edits/15.seqid, newMaxSeqId=15, maxSeqId=1 2023-07-11 17:56:01,847 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,2,1689098042452.47ee8c355f31465b357785487e314b0f. 2023-07-11 17:56:01,847 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 47ee8c355f31465b357785487e314b0f: 2023-07-11 17:56:01,847 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,2,1689098042452.47ee8c355f31465b357785487e314b0f. 2023-07-11 17:56:01,847 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 03ba78e07b3026a36a7cde3865422d82, disabling compactions & flushes 2023-07-11 17:56:01,847 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,,1689098116506.03ba78e07b3026a36a7cde3865422d82. 2023-07-11 17:56:01,847 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,,1689098116506.03ba78e07b3026a36a7cde3865422d82. 2023-07-11 17:56:01,847 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,,1689098116506.03ba78e07b3026a36a7cde3865422d82. after waiting 0 ms 2023-07-11 17:56:01,847 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,,1689098116506.03ba78e07b3026a36a7cde3865422d82. 2023-07-11 17:56:01,850 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/03ba78e07b3026a36a7cde3865422d82/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-07-11 17:56:01,850 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,,1689098116506.03ba78e07b3026a36a7cde3865422d82. 2023-07-11 17:56:01,850 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 03ba78e07b3026a36a7cde3865422d82: 2023-07-11 17:56:01,851 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,,1689098116506.03ba78e07b3026a36a7cde3865422d82. 2023-07-11 17:56:01,851 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 32200e46ee32133355d305b07aa3b428, disabling compactions & flushes 2023-07-11 17:56:01,851 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,2,1689098116506.32200e46ee32133355d305b07aa3b428. 2023-07-11 17:56:01,851 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,2,1689098116506.32200e46ee32133355d305b07aa3b428. 2023-07-11 17:56:01,851 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,2,1689098116506.32200e46ee32133355d305b07aa3b428. after waiting 0 ms 2023-07-11 17:56:01,851 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,2,1689098116506.32200e46ee32133355d305b07aa3b428. 2023-07-11 17:56:01,853 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/ns/testMinorCompaction/32200e46ee32133355d305b07aa3b428/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-07-11 17:56:01,854 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,2,1689098116506.32200e46ee32133355d305b07aa3b428. 2023-07-11 17:56:01,854 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 32200e46ee32133355d305b07aa3b428: 2023-07-11 17:56:01,854 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,2,1689098116506.32200e46ee32133355d305b07aa3b428. 2023-07-11 17:56:01,854 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing c81222d442c0705212f76de2b50cf141, disabling compactions & flushes 2023-07-11 17:56:01,854 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689098000985.c81222d442c0705212f76de2b50cf141. 2023-07-11 17:56:01,854 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689098000985.c81222d442c0705212f76de2b50cf141. 2023-07-11 17:56:01,854 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689098000985.c81222d442c0705212f76de2b50cf141. after waiting 0 ms 2023-07-11 17:56:01,854 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689098000985.c81222d442c0705212f76de2b50cf141. 2023-07-11 17:56:01,854 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing c81222d442c0705212f76de2b50cf141 1/1 column families, dataSize=109 B heapSize=592 B 2023-07-11 17:56:01,860 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=109 B at sequenceid=7 (bloomFilter=true), to=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/hbase/namespace/c81222d442c0705212f76de2b50cf141/.tmp/info/2fede39c2bf847ada9dbb7943f0c4345 2023-07-11 17:56:01,864 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/hbase/namespace/c81222d442c0705212f76de2b50cf141/.tmp/info/2fede39c2bf847ada9dbb7943f0c4345 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/hbase/namespace/c81222d442c0705212f76de2b50cf141/info/2fede39c2bf847ada9dbb7943f0c4345 2023-07-11 17:56:01,868 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/hbase/namespace/c81222d442c0705212f76de2b50cf141/info/2fede39c2bf847ada9dbb7943f0c4345, entries=3, sequenceid=7, filesize=4.8 K 2023-07-11 17:56:01,869 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~109 B/109, heapSize ~576 B/576, currentSize=0 B/0 for c81222d442c0705212f76de2b50cf141 in 15ms, sequenceid=7, compaction requested=false 2023-07-11 17:56:01,873 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/hbase/namespace/c81222d442c0705212f76de2b50cf141/recovered.edits/10.seqid, newMaxSeqId=10, maxSeqId=1 2023-07-11 17:56:01,874 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689098000985.c81222d442c0705212f76de2b50cf141. 2023-07-11 17:56:01,874 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for c81222d442c0705212f76de2b50cf141: 2023-07-11 17:56:01,874 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1689098000985.c81222d442c0705212f76de2b50cf141. 2023-07-11 17:56:01,874 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 0500066ce9a917d77efcb830c43e6a63, disabling compactions & flushes 2023-07-11 17:56:01,874 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,2,1689098143639.0500066ce9a917d77efcb830c43e6a63. 2023-07-11 17:56:01,874 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,2,1689098143639.0500066ce9a917d77efcb830c43e6a63. 2023-07-11 17:56:01,874 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,2,1689098143639.0500066ce9a917d77efcb830c43e6a63. after waiting 0 ms 2023-07-11 17:56:01,874 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,2,1689098143639.0500066ce9a917d77efcb830c43e6a63. 2023-07-11 17:56:01,880 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionFromAdmin/0500066ce9a917d77efcb830c43e6a63/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-07-11 17:56:01,881 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,2,1689098143639.0500066ce9a917d77efcb830c43e6a63. 2023-07-11 17:56:01,881 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 0500066ce9a917d77efcb830c43e6a63: 2023-07-11 17:56:01,881 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,2,1689098143639.0500066ce9a917d77efcb830c43e6a63. 2023-07-11 17:56:01,882 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 17aacf583da279539e944e5353cb4f95, disabling compactions & flushes 2023-07-11 17:56:01,882 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,2,1689098094325.17aacf583da279539e944e5353cb4f95. 2023-07-11 17:56:01,882 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1689098094325.17aacf583da279539e944e5353cb4f95. 2023-07-11 17:56:01,882 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,2,1689098094325.17aacf583da279539e944e5353cb4f95. after waiting 0 ms 2023-07-11 17:56:01,882 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,2,1689098094325.17aacf583da279539e944e5353cb4f95. 2023-07-11 17:56:01,884 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/17aacf583da279539e944e5353cb4f95/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-07-11 17:56:01,886 INFO [regionserver/jenkins-hbase9:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-11 17:56:01,886 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,2,1689098094325.17aacf583da279539e944e5353cb4f95. 2023-07-11 17:56:01,886 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 17aacf583da279539e944e5353cb4f95: 2023-07-11 17:56:01,886 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,2,1689098094325.17aacf583da279539e944e5353cb4f95. 2023-07-11 17:56:01,886 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 8c00c428ffdb4840522b5e5a88c37ff1, disabling compactions & flushes 2023-07-11 17:56:01,886 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689098075959.8c00c428ffdb4840522b5e5a88c37ff1. 2023-07-11 17:56:01,886 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689098075959.8c00c428ffdb4840522b5e5a88c37ff1. 2023-07-11 17:56:01,886 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689098075959.8c00c428ffdb4840522b5e5a88c37ff1. after waiting 0 ms 2023-07-11 17:56:01,886 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689098075959.8c00c428ffdb4840522b5e5a88c37ff1. 2023-07-11 17:56:01,889 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8c00c428ffdb4840522b5e5a88c37ff1/recovered.edits/58.seqid, newMaxSeqId=58, maxSeqId=55 2023-07-11 17:56:01,889 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689098075959.8c00c428ffdb4840522b5e5a88c37ff1. 2023-07-11 17:56:01,889 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 8c00c428ffdb4840522b5e5a88c37ff1: 2023-07-11 17:56:01,889 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1689098075959.8c00c428ffdb4840522b5e5a88c37ff1. 2023-07-11 17:56:01,889 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing dada713f65e06525f8aa63e933747743, disabling compactions & flushes 2023-07-11 17:56:01,889 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689098059290.dada713f65e06525f8aa63e933747743. 2023-07-11 17:56:01,889 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689098059290.dada713f65e06525f8aa63e933747743. 2023-07-11 17:56:01,889 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689098059290.dada713f65e06525f8aa63e933747743. after waiting 0 ms 2023-07-11 17:56:01,889 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689098059290.dada713f65e06525f8aa63e933747743. 2023-07-11 17:56:01,892 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/dada713f65e06525f8aa63e933747743/recovered.edits/58.seqid, newMaxSeqId=58, maxSeqId=55 2023-07-11 17:56:01,892 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689098059290.dada713f65e06525f8aa63e933747743. 2023-07-11 17:56:01,892 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for dada713f65e06525f8aa63e933747743: 2023-07-11 17:56:01,893 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1689098059290.dada713f65e06525f8aa63e933747743. 2023-07-11 17:56:01,893 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing c13bb432df8709c95734bd08b015997b, disabling compactions & flushes 2023-07-11 17:56:01,893 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,1,1689098094325.c13bb432df8709c95734bd08b015997b. 2023-07-11 17:56:01,893 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1689098094325.c13bb432df8709c95734bd08b015997b. 2023-07-11 17:56:01,893 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,1,1689098094325.c13bb432df8709c95734bd08b015997b. after waiting 0 ms 2023-07-11 17:56:01,893 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,1,1689098094325.c13bb432df8709c95734bd08b015997b. 2023-07-11 17:56:01,896 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/c13bb432df8709c95734bd08b015997b/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-07-11 17:56:01,896 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,1,1689098094325.c13bb432df8709c95734bd08b015997b. 2023-07-11 17:56:01,896 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for c13bb432df8709c95734bd08b015997b: 2023-07-11 17:56:01,896 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,1,1689098094325.c13bb432df8709c95734bd08b015997b. 2023-07-11 17:56:01,896 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 55b22085c6b006e3a631c2a366691bf8, disabling compactions & flushes 2023-07-11 17:56:01,896 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,,1689098042452.55b22085c6b006e3a631c2a366691bf8. 2023-07-11 17:56:01,896 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,,1689098042452.55b22085c6b006e3a631c2a366691bf8. 2023-07-11 17:56:01,896 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,,1689098042452.55b22085c6b006e3a631c2a366691bf8. after waiting 0 ms 2023-07-11 17:56:01,896 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,,1689098042452.55b22085c6b006e3a631c2a366691bf8. 2023-07-11 17:56:01,898 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testScannerOnBulkLoadRefHFiles/55b22085c6b006e3a631c2a366691bf8/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-07-11 17:56:01,899 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,,1689098042452.55b22085c6b006e3a631c2a366691bf8. 2023-07-11 17:56:01,899 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 55b22085c6b006e3a631c2a366691bf8: 2023-07-11 17:56:01,899 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,,1689098042452.55b22085c6b006e3a631c2a366691bf8. 2023-07-11 17:56:01,899 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 79dd09a662e99a3de62daf35d6a0df12, disabling compactions & flushes 2023-07-11 17:56:01,899 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithMonthlyPolicy,,1689098017322.79dd09a662e99a3de62daf35d6a0df12. 2023-07-11 17:56:01,899 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithMonthlyPolicy,,1689098017322.79dd09a662e99a3de62daf35d6a0df12. 2023-07-11 17:56:01,899 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithMonthlyPolicy,,1689098017322.79dd09a662e99a3de62daf35d6a0df12. after waiting 0 ms 2023-07-11 17:56:01,899 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithMonthlyPolicy,,1689098017322.79dd09a662e99a3de62daf35d6a0df12. 2023-07-11 17:56:01,901 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testMajorCompactionWithMonthlyPolicy/79dd09a662e99a3de62daf35d6a0df12/recovered.edits/52.seqid, newMaxSeqId=52, maxSeqId=1 2023-07-11 17:56:01,902 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithMonthlyPolicy,,1689098017322.79dd09a662e99a3de62daf35d6a0df12. 2023-07-11 17:56:01,902 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 79dd09a662e99a3de62daf35d6a0df12: 2023-07-11 17:56:01,902 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithMonthlyPolicy,,1689098017322.79dd09a662e99a3de62daf35d6a0df12. 2023-07-11 17:56:01,902 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 64a1f72c6487e7f4ae550729b9dbcb83, disabling compactions & flushes 2023-07-11 17:56:01,902 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,1,1689098042452.64a1f72c6487e7f4ae550729b9dbcb83. 2023-07-11 17:56:01,902 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,1,1689098042452.64a1f72c6487e7f4ae550729b9dbcb83. 2023-07-11 17:56:01,902 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,1,1689098042452.64a1f72c6487e7f4ae550729b9dbcb83. after waiting 0 ms 2023-07-11 17:56:01,902 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,1,1689098042452.64a1f72c6487e7f4ae550729b9dbcb83. 2023-07-11 17:56:01,904 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testScannerOnBulkLoadRefHFiles/64a1f72c6487e7f4ae550729b9dbcb83/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-07-11 17:56:01,904 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,1,1689098042452.64a1f72c6487e7f4ae550729b9dbcb83. 2023-07-11 17:56:01,904 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 64a1f72c6487e7f4ae550729b9dbcb83: 2023-07-11 17:56:01,904 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,1,1689098042452.64a1f72c6487e7f4ae550729b9dbcb83. 2023-07-11 17:56:01,904 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 0b68e8a6a3555cdd10a16d0303c35da7, disabling compactions & flushes 2023-07-11 17:56:01,905 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,,1689098094325.0b68e8a6a3555cdd10a16d0303c35da7. 2023-07-11 17:56:01,905 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,,1689098094325.0b68e8a6a3555cdd10a16d0303c35da7. 2023-07-11 17:56:01,905 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,,1689098094325.0b68e8a6a3555cdd10a16d0303c35da7. after waiting 0 ms 2023-07-11 17:56:01,905 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,,1689098094325.0b68e8a6a3555cdd10a16d0303c35da7. 2023-07-11 17:56:01,907 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/default/testCompactionWithHFileLink/0b68e8a6a3555cdd10a16d0303c35da7/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-07-11 17:56:01,908 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,,1689098094325.0b68e8a6a3555cdd10a16d0303c35da7. 2023-07-11 17:56:01,908 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 0b68e8a6a3555cdd10a16d0303c35da7: 2023-07-11 17:56:01,908 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,,1689098094325.0b68e8a6a3555cdd10a16d0303c35da7. 2023-07-11 17:56:02,016 DEBUG [RS:0;jenkins-hbase9:45839] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-07-11 17:56:02,216 DEBUG [RS:0;jenkins-hbase9:45839] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-07-11 17:56:02,236 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=102 B at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/hbase/meta/1588230740/.tmp/rep_barrier/1cf974040b70488990c15bf8d76ad5ed 2023-07-11 17:56:02,239 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1cf974040b70488990c15bf8d76ad5ed 2023-07-11 17:56:02,362 INFO [regionserver/jenkins-hbase9:0.Chore.2] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-07-11 17:56:02,363 INFO [regionserver/jenkins-hbase9:0.Chore.2] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-07-11 17:56:02,417 DEBUG [RS:0;jenkins-hbase9:45839] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-07-11 17:56:02,617 DEBUG [RS:0;jenkins-hbase9:45839] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-07-11 17:56:02,646 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.18 KB at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/hbase/meta/1588230740/.tmp/table/365073bded1a49a29afa14df1d84063f 2023-07-11 17:56:02,650 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 365073bded1a49a29afa14df1d84063f 2023-07-11 17:56:02,651 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/hbase/meta/1588230740/.tmp/info/9eaa4059a73e487e9682249cce7c56b3 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/hbase/meta/1588230740/info/9eaa4059a73e487e9682249cce7c56b3 2023-07-11 17:56:02,655 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9eaa4059a73e487e9682249cce7c56b3 2023-07-11 17:56:02,655 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/hbase/meta/1588230740/info/9eaa4059a73e487e9682249cce7c56b3, entries=226, sequenceid=130, filesize=37.9 K 2023-07-11 17:56:02,656 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/hbase/meta/1588230740/.tmp/rep_barrier/1cf974040b70488990c15bf8d76ad5ed as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/hbase/meta/1588230740/rep_barrier/1cf974040b70488990c15bf8d76ad5ed 2023-07-11 17:56:02,659 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1cf974040b70488990c15bf8d76ad5ed 2023-07-11 17:56:02,659 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/hbase/meta/1588230740/rep_barrier/1cf974040b70488990c15bf8d76ad5ed, entries=1, sequenceid=130, filesize=5.0 K 2023-07-11 17:56:02,659 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/hbase/meta/1588230740/.tmp/table/365073bded1a49a29afa14df1d84063f as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/hbase/meta/1588230740/table/365073bded1a49a29afa14df1d84063f 2023-07-11 17:56:02,664 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 365073bded1a49a29afa14df1d84063f 2023-07-11 17:56:02,664 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/hbase/meta/1588230740/table/365073bded1a49a29afa14df1d84063f, entries=27, sequenceid=130, filesize=6.6 K 2023-07-11 17:56:02,667 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~50.56 KB/51772, heapSize ~78.19 KB/80064, currentSize=0 B/0 for 1588230740 in 852ms, sequenceid=130, compaction requested=false 2023-07-11 17:56:02,673 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/data/hbase/meta/1588230740/recovered.edits/133.seqid, newMaxSeqId=133, maxSeqId=1 2023-07-11 17:56:02,674 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-11 17:56:02,674 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-11 17:56:02,674 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-11 17:56:02,674 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-11 17:56:02,817 INFO [RS:0;jenkins-hbase9:45839] regionserver.HRegionServer(1170): stopping server jenkins-hbase9.apache.org,45839,1689097999112; all regions closed. 2023-07-11 17:56:02,825 DEBUG [RS:0;jenkins-hbase9:45839] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/oldWALs 2023-07-11 17:56:02,825 INFO [RS:0;jenkins-hbase9:45839] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C45839%2C1689097999112.meta:.meta(num 1689098000722) 2023-07-11 17:56:02,829 DEBUG [RS:0;jenkins-hbase9:45839] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/oldWALs 2023-07-11 17:56:02,829 INFO [RS:0;jenkins-hbase9:45839] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C45839%2C1689097999112:(num 1689098000503) 2023-07-11 17:56:02,829 DEBUG [RS:0;jenkins-hbase9:45839] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 17:56:02,829 INFO [RS:0;jenkins-hbase9:45839] regionserver.LeaseManager(133): Closed leases 2023-07-11 17:56:02,830 INFO [RS:0;jenkins-hbase9:45839] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase9:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-11 17:56:02,830 INFO [regionserver/jenkins-hbase9:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-11 17:56:02,831 INFO [RS:0;jenkins-hbase9:45839] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:45839 2023-07-11 17:56:02,839 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-11 17:56:02,840 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase9.apache.org,45839,1689097999112] 2023-07-11 17:56:02,840 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase9.apache.org,45839,1689097999112; numProcessing=1 2023-07-11 17:56:02,840 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,45839,1689097999112 2023-07-11 17:56:02,840 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-11 17:56:02,842 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase9.apache.org,45839,1689097999112 already deleted, retry=false 2023-07-11 17:56:02,842 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase9.apache.org,45839,1689097999112 expired; onlineServers=0 2023-07-11 17:56:02,842 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase9.apache.org,36885,1689097997830' ***** 2023-07-11 17:56:02,842 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-11 17:56:02,842 DEBUG [M:0;jenkins-hbase9:36885] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@65cd3a24, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-07-11 17:56:02,842 INFO [M:0;jenkins-hbase9:36885] regionserver.HRegionServer(1144): stopping server jenkins-hbase9.apache.org,36885,1689097997830 2023-07-11 17:56:02,842 INFO [M:0;jenkins-hbase9:36885] regionserver.HRegionServer(1170): stopping server jenkins-hbase9.apache.org,36885,1689097997830; all regions closed. 2023-07-11 17:56:02,842 DEBUG [M:0;jenkins-hbase9:36885] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 17:56:02,843 DEBUG [M:0;jenkins-hbase9:36885] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-11 17:56:02,843 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-11 17:56:02,843 DEBUG [M:0;jenkins-hbase9:36885] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-11 17:56:02,843 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.small.0-1689098000210] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.small.0-1689098000210,5,FailOnTimeoutGroup] 2023-07-11 17:56:02,843 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.large.0-1689098000208] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.large.0-1689098000208,5,FailOnTimeoutGroup] 2023-07-11 17:56:02,843 INFO [M:0;jenkins-hbase9:36885] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-11 17:56:02,843 INFO [M:0;jenkins-hbase9:36885] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-11 17:56:02,843 INFO [M:0;jenkins-hbase9:36885] hbase.ChoreService(369): Chore service for: master/jenkins-hbase9:0 had [] on shutdown 2023-07-11 17:56:02,844 DEBUG [M:0;jenkins-hbase9:36885] master.HMaster(1512): Stopping service threads 2023-07-11 17:56:02,844 INFO [M:0;jenkins-hbase9:36885] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-11 17:56:02,844 ERROR [M:0;jenkins-hbase9:36885] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-19,5,PEWorkerGroup] Thread[HFileArchiver-20,5,PEWorkerGroup] Thread[HFileArchiver-21,5,PEWorkerGroup] Thread[HFileArchiver-22,5,PEWorkerGroup] 2023-07-11 17:56:02,845 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-11 17:56:02,845 INFO [M:0;jenkins-hbase9:36885] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-11 17:56:02,845 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 17:56:02,845 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-11 17:56:02,845 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-11 17:56:02,845 DEBUG [M:0;jenkins-hbase9:36885] zookeeper.ZKUtil(398): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-11 17:56:02,845 WARN [M:0;jenkins-hbase9:36885] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-11 17:56:02,845 INFO [M:0;jenkins-hbase9:36885] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-11 17:56:02,846 INFO [M:0;jenkins-hbase9:36885] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-11 17:56:02,846 DEBUG [M:0;jenkins-hbase9:36885] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-11 17:56:02,846 INFO [M:0;jenkins-hbase9:36885] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-11 17:56:02,846 DEBUG [M:0;jenkins-hbase9:36885] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-11 17:56:02,846 DEBUG [M:0;jenkins-hbase9:36885] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-11 17:56:02,846 DEBUG [M:0;jenkins-hbase9:36885] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-11 17:56:02,846 INFO [M:0;jenkins-hbase9:36885] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=512.74 KB heapSize=598.87 KB 2023-07-11 17:56:02,944 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-11 17:56:02,944 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): regionserver:45839-0x1015576ce490001, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-11 17:56:02,944 INFO [RS:0;jenkins-hbase9:45839] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase9.apache.org,45839,1689097999112; zookeeper connection closed. 2023-07-11 17:56:02,944 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@203767c0] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@203767c0 2023-07-11 17:56:02,945 INFO [Listener at localhost/43271] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 1 regionserver(s) complete 2023-07-11 17:56:03,255 INFO [M:0;jenkins-hbase9:36885] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=512.74 KB at sequenceid=1011 (bloomFilter=true), to=hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/184337ebad0144bf9e598986ed7b3771 2023-07-11 17:56:03,259 INFO [M:0;jenkins-hbase9:36885] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 184337ebad0144bf9e598986ed7b3771 2023-07-11 17:56:03,259 DEBUG [M:0;jenkins-hbase9:36885] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/184337ebad0144bf9e598986ed7b3771 as hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/184337ebad0144bf9e598986ed7b3771 2023-07-11 17:56:03,262 INFO [M:0;jenkins-hbase9:36885] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 184337ebad0144bf9e598986ed7b3771 2023-07-11 17:56:03,262 INFO [M:0;jenkins-hbase9:36885] regionserver.HStore(1080): Added hdfs://localhost:42127/user/jenkins/test-data/2cc5c3ae-65a9-e107-e28c-b5506af85d88/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/184337ebad0144bf9e598986ed7b3771, entries=123, sequenceid=1011, filesize=33.3 K 2023-07-11 17:56:03,263 INFO [M:0;jenkins-hbase9:36885] regionserver.HRegion(2948): Finished flush of dataSize ~512.74 KB/525043, heapSize ~598.85 KB/613224, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 417ms, sequenceid=1011, compaction requested=false 2023-07-11 17:56:03,264 INFO [M:0;jenkins-hbase9:36885] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-11 17:56:03,264 DEBUG [M:0;jenkins-hbase9:36885] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-11 17:56:03,267 INFO [M:0;jenkins-hbase9:36885] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-11 17:56:03,267 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-11 17:56:03,268 INFO [M:0;jenkins-hbase9:36885] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:36885 2023-07-11 17:56:03,273 DEBUG [M:0;jenkins-hbase9:36885] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase9.apache.org,36885,1689097997830 already deleted, retry=false 2023-07-11 17:56:03,375 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-11 17:56:03,375 INFO [M:0;jenkins-hbase9:36885] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase9.apache.org,36885,1689097997830; zookeeper connection closed. 2023-07-11 17:56:03,375 DEBUG [Listener at localhost/43271-EventThread] zookeeper.ZKWatcher(600): master:36885-0x1015576ce490000, quorum=127.0.0.1:50702, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-11 17:56:03,377 WARN [Listener at localhost/43271] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-11 17:56:03,380 INFO [Listener at localhost/43271] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-11 17:56:03,488 WARN [BP-735400681-172.31.2.10-1689097994513 heartbeating to localhost/127.0.0.1:42127] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-11 17:56:03,489 WARN [BP-735400681-172.31.2.10-1689097994513 heartbeating to localhost/127.0.0.1:42127] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-735400681-172.31.2.10-1689097994513 (Datanode Uuid c68fe1db-4d65-4eb5-9533-0a1564728d74) service to localhost/127.0.0.1:42127 2023-07-11 17:56:03,491 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/0ffa2fd0-9ac7-3acf-2d07-d63463e28c78/cluster_34dba087-9207-891f-190b-e8a2fc02141e/dfs/data/data1/current/BP-735400681-172.31.2.10-1689097994513] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-11 17:56:03,491 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/0ffa2fd0-9ac7-3acf-2d07-d63463e28c78/cluster_34dba087-9207-891f-190b-e8a2fc02141e/dfs/data/data2/current/BP-735400681-172.31.2.10-1689097994513] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-11 17:56:03,517 INFO [Listener at localhost/43271] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-11 17:56:03,648 INFO [Listener at localhost/43271] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-11 17:56:03,727 INFO [Listener at localhost/43271] hbase.HBaseTestingUtility(1293): Minicluster is down